SYLIN

Evolving Infra

by MIT · Paper · Text & code

Online-adaptive agentic serving reports up to 4.1x lower latency and 14x lower P95 TTFT than NVIDIA Dynamo on up to 256 GB300s

StatusResearch