Basalt
by jesdga95 · Runtime · Text & code
Developer reports up to 776 tok/s structured output from Qwen3.8-27B, 262 in chat and 194 for prose; readers want longer 4-bit prefill quality tests
Alternatives
Works with
by jesdga95 · Runtime · Text & code
Developer reports up to 776 tok/s structured output from Qwen3.8-27B, 262 in chat and 194 for prose; readers want longer 4-bit prefill quality tests