I have actually open sourced one recently which supports queues - its both a des... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		friendly_chap on June 2, 2024 \| parent \| context \| favorite \| on: Show HN: Open-source load balancer for llama.cpp I have actually open sourced one recently which supports queues - its both a desktop app and a daemon: https://github.com/singulatron/singulatron

3abiton on June 2, 2024 [–]

So many interesting projects, I just wish AI hardware was readily available.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact