SYLIN

Kimi Delta Attention

by Moonshot AI · Technique · Text & code

KDA is not new; the reviewer already covered it. Used in K3 alongside attention residuals