Kimi Delta Attention
by Moonshot AI · Technique · Text & code
KDA is not new; the reviewer already covered it. Used in K3 alongside attention residuals
by Moonshot AI · Technique · Text & code
KDA is not new; the reviewer already covered it. Used in K3 alongside attention residuals