by LightSeek · Runtime · Text & code
Serves Kimi K3 NVFP4 at 331 output tok/s per GPU on 32 GB300s, 1.92x a DCP8 baseline