ninfer
by neroued · Runtime · Text & code
Reported about 200 tok/s, over 400 tok/s with concurrent requests, running Qwen 3.8 27B on one RTX 5090
Evidence
- Aug 28Users on RTX 5090s report over 100 tok/s running Qwen3.8 27B with ninfer; non-5090 ports exist