AN EXPONENTIAL LEARNING RATE SCHEDULE FOR DEEP LEARNING

Keyphrases

• Exponential Learning 100%
• Group Normalization 33%
• Layer Normalization 33%
• Learning Rate Schedule 100%
• Normalization Layer 33%
• SGD with Momentum 33%

Computer Science

• Batch Normalization 25%
• Deep Learning 100%
• Learning Rate 100%
• Rigorous Proof 25%
• Use Case 25%

Mathematics

• Network Weight 50%
• Tuning Weight 50%