Looped transformers
Technique · Text & code
Explained as reusing the same block weights to double effective depth (22 to 44 applications) without more parameters or GPU memory
StatusResearch
Evidence
- Sep 9Still emits one token at a time; article argues it does not necessarily make chain-of-thought less informative