Hacker Newsnew | past | comments | ask | show | jobs | submit | m0do1's commentslogin

prismML provides a llama.cpp fork which is compatible with the 1 bit models:

https://github.com/PrismML-Eng/llama.cpp

After fails with Ollama and main llama.cpp the fork worked on my M5 MBA.

Edit: Typos


In Austria, Aldi (South) is called Hofer.


This provides a good overview of packages for various applications: https://github.com/ringabout/awesome-nim

I think most of them are available via nimble.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: