Looped Transformers as Programmable Computers

Keyphrases

• Transformer 100%
• Transformer Network 100%
• Backpropagation 33%
• Encoder 33%
• Function Call 33%
• Iterative Algorithm 33%
• Constant Depth 33%
• Conditional Branch 33%
• Instruction Set Architecture 33%
• Nonlinear Function 33%
• Calculator 33%
• Program Counter 33%
• Punch Card 33%
• Specific Weight 33%
• Universal Computer 33%
• Linear Algebra Libraries 33%
• In-context Learning 33%
• Input Sequence 33%

Computer Science

• Transformer Network 100%
• Learning Algorithm 33%
• Function Call 33%
• Computer Architecture 33%
• Conditional Branch 33%
• Iterative Algorithm 33%
• Nonlinear Function 33%
• Program Counter 33%
• Compute Unit 33%
• Punch Card 33%