Deltafin

by Argonaut Labs · Tool · Text & code

Native engine streaming MoE experts from four SSDs; runs the 2.8T Kimi K3 on one MacBook Pro

AccessOpen codePricefreeRuns onmacOS, LinuxLicenseMIT

Evidence

  1. Sep 8
    Seen as a proof of concept; commenters think the approach is more useful for smaller MoE models and expect slowdown at long context