Speculative KV coding: losslessly compressing KV cache by up to ~4× | Hacker News

Speculative KV coding: losslessly compressing KV cache by up to ~4× (fergusfinn.com)

124 points by kkm 3 days ago | 20 comments

Loading...