Evolving Infra
by MIT · Paper · Text & code
Online-adaptive agentic serving reports up to 4.1x lower latency and 14x lower P95 TTFT than NVIDIA Dynamo on up to 256 GB300s
StatusResearch
by MIT · Paper · Text & code
Online-adaptive agentic serving reports up to 4.1x lower latency and 14x lower P95 TTFT than NVIDIA Dynamo on up to 256 GB300s