AMD Instinct
by AMD · Hardware · Text & code
MI355X running vLLM with open FlyDSL kernels beats Blackwell on MiniMax M3.1, a more than 3x improvement
Evidence
- Sep 7vLLM benchmarks speculative decoding on MI300X and MI355X; some configurations ran slower than no speculation
- Aug 2Used as proof that a competitive model can be trained from scratch on non-Nvidia, non-CUDA hardware