Lecture 11: Regularization of NNs

Key Word(s): Weight Decay, L1, L2, Early Stopping, Dropout, Data Augmentation

Slides

• Lecture 11 : Parameter Initialization (PDF)
• Lecture 11 : Regularization: L2 & L1 Norm and Early Stopping (PDF)
• Lecture 11 : Regularization: Data Augmentation & Dropout (PDF)
• Lecture 11 : Batch Norm (PDF)

Exercises

• Lecture 11: Exercise: Dropout [Notebook]
• Lecture 11: Exercise: Early Stopping [Notebook]
• Lecture 11: Exercise: Model pruning using Lasso regularization [Notebook]