SYLIN

Z Lab

Maker · 1 entry

Everything from Z Lab

NameWhat to knowPrice or memoryRanks
DFlashModelDFlash 2 keeps the top 16 candidates per draft position, picks the best path with a lightweight selector, and adds a small convolution, gaining one more accepted token per pass for about 1% extra latency~77 GB