my little brother kept asking me for bedtime stories so i made a model that tells them.
its basically lilstory but bigger, around 50m params and 13 layers, still trained on tinystories on my mac. i also fixed some stuff from lilstory. the learning rate warms up and then slowly goes down now instead of just staying the same, and it exports to gguf so it runs in ollama and llama.cpp.
ollama run navthings/tale
or just try it in your browser, no install.
the one thats up has only done 2000 steps so its pretty early. it writes simple stories but still loses the plot sometimes (literally).