Advanced Section 1: Optimization/Dropout

Key Word(s): dropout, batch normalization, moving average, exponential weights, optimization, Adam, RMSprop, AMSGrad, sgd, momentum



Slides

Lecture notes