Surpassing vLLM with a Generated Inference Stack | Hacker News

new | ask | show | jobs

Surpassing vLLM with a Generated Inference Stack (infinity.inc)

13 points by lukebechtel 4 hours ago | 4 comments

Loading...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search:

yet another Hacker News client · github.com/reiuyuu/nhn