Note: at time stamp 2:15 I said clip by norm but written clip by value over there. I apologize for that and confirm that it is "Clip by Norm".
Exploding Gradient Problem was the biggest problem (especially in RNN) while training Neural Networks that cause weights to explode and networks to become unstable and impossible to converge.
In this video, we'll see how Gradient Clipping helps solve Exploding Gradient problems.
I hope you like it.
Stay tuned. Thanks for watching
Timestamps:
0:00 Intro to Exploding Gradient
1:08 Gradient Clipping
