Hypura – A storage-tier-aware LLM inference scheduler for Apple Silicon | Hacker News

Hypura – A storage-tier-aware LLM inference scheduler for Apple Silicon (github.com)

149 points by tatef 4 hours ago | 63 comments

Loading...