Multi-Branch Transformer
by gaotangli · Paper · Text & code
Branching Transformer blocks into parallel parameterized branches, combined with shared KV caching, improves language model quality and inference efficiency compared with standard sequential Transformers.
StatusResearch