Multi-Branch Transformer

by gaotangli · Paper · Text & code

Branching Transformer blocks into parallel parameterized branches, combined with shared KV caching, improves language model quality and inference efficiency compared with standard sequential Transformers.

StatusResearch