Zyphra subquadratic attention

by Zyphra · Technique · Text & code

Claims 9-60x speedups at 10M tokens after converting models; Qwen loses under two points on RULER at 1M

StatusResearch