Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Personally I'd recommend Ollama, because they have a good model (dockeresque), the APIs are quite more widely supported

You can mix models in a single model file, it's a feature I've been experimenting with lately

Note: you don't have to rely on their model Library, you can use your own. Secondly, support for new models is through their bindings with llama.cpp



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: