Do transformers need three projections? Systematic study of QKV variants | Hacker News

Do transformers need three projections? Systematic study of QKV variants (arxiv.org)

202 points by Anon84 19 hours ago | 43 comments

Loading...