Deep Learning
Optimizers
SGD, Momentum, RMSProp, Adam and AdamW compared visually, plus learning-rate schedules.
- Intermediate
- About 4 hours
- 1 modules
- 5 lessons
- Free
This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.
What you will learn
- OptimisersGradient Descent Recap, SGD and Mini-Batches, Momentum and more
Course syllabus
Not released yet · full syllabus below
- 1
Optimisers
5 lessons- 1Gradient Descent RecapSoon
- 2SGD and Mini-BatchesSoon
- 3MomentumSoon
- 4Adam and AdamWSoon
- 5Learning Rate SchedulesSoon