SYLIN

Deepgrove

Maker · 2 entries

Everything from Deepgrove

NameWhat to knowPrice or memoryRanks
Deep Grove llama.cpp forkRuntimeTernary kernels live only in Deep Grove's own llama.cpp fork, not mainline llama.cpp; took a long time to build
Maple-PreviewModel20B-total, 1.5B-active MoE (256 experts, 8 active) with ternary experts and attention, MIT license, under 6 GB packed~5.9 GB