Optically Connected Multi-Stack HBM Modules for Large Language Model Training and Inference

Keyphrases

• Memory Module 100%
• High Bandwidth Memory 100%
• Large Language Models 100%
• Training Model 100%
• Model Inference 100%
• Multi-stack 100%
• Memory Systems 50%
• Memory Stacking 33%
• Memory Architecture 16%
• System Architecture 16%
• Memory Bandwidth 16%
• Training Effectiveness 16%
• Memory Capacity 16%
• Inference Performance 16%
• Chiplet 16%
• A100 16%
• Silicon Photonic Interconnect on chip 16%

Computer Science

• Large Language Model 100%
• Bandwidth Memory 100%
• Memory System 50%
• Silicon Photonics 16%
• Input/Output 16%
• Memory Architecture 16%
• Memory Bandwidth 16%
• Parameter Model 16%
• Memory Capacity 16%
• Photonic Interconnect 16%
• System Architecture 16%