TokenSpeed

by LightSeek · Runtime · Text & code

Serves Kimi K3 NVFP4 at 331 output tok/s per GPU on 32 GB300s, 1.92x a DCP8 baseline

AccessOpen codeLicenseMIT