AutoSP: Long-Context LLM Training via Compiler-Based Sequence Parallelism | Hacker News

AutoSP: Long-Context LLM Training via Compiler-Based Sequence Parallelism (pytorch.org)

1 point by matt_d 7 hours ago | discuss