Were finally able to add music generation to #KoboldCpp ! And since it reuses all the large backend code from ggml it won't bloat us down adding it. Don't like music and just want your LLM backend to stay unbloated? No problem, don't load a music model and it won't impact you.

But if you like music gen what we are integrating can be very fast and produce really fun results. Been having a blast with ace-step 1.5 since it released and soon you can enjoy it inside KoboldCpp to.

And of course for those who don't yet know its an #ai program that lets you run #llm 's locally alongside #imagegen and more! But with a portable binary that is small for what it can do.