Zyphra subquadratic attention
by Zyphra · Technique · Text & code
Claims 9-60x speedups at 10M tokens after converting models; Qwen loses under two points on RULER at 1M
StatusResearch
by Zyphra · Technique · Text & code
Claims 9-60x speedups at 10M tokens after converting models; Qwen loses under two points on RULER at 1M