VideoDeltaNet
Technique · Video
Hybrid attention for MiniMax H3: full attention for nearby frames, linear attention for distant ones; attention was about 85% of runtime
Technique · Video
Hybrid attention for MiniMax H3: full attention for nearby frames, linear attention for distant ones; attention was about 85% of runtime