MMFlash
by National University of Singapore · Paper · Text & code
MMFlash improves multimodal speculative decoding by adaptively upweighting visually dependent tokens and using sparse attention for long video, yielding up to 3.58× lossless speedup.
StatusResearch