Deep Learning
Activation Functions
The switch inside each neuron. Compare Sigmoid, Tanh, ReLU, GELU and Softmax and learn which to use where.
- Intermediate
- About 3 hours
- 1 modules
- 5 lessons
- Free
This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.
What you will learn
- ActivationsWhy Activations Are Needed, Sigmoid and Tanh, ReLU and Its Variants and more
Course syllabus
Not released yet · full syllabus below
- 1
Activations
5 lessons- 1Why Activations Are NeededSoon
- 2Sigmoid and TanhSoon
- 3ReLU and Its VariantsSoon
- 4GELU and SwishSoon
- 5Softmax for OutputsSoon