What happens when the learning rate is high?
What happens when the learning rate is high? Correct Answer Most of the times, it overshoots the minima
If the learning rate is high, the gradient descent overshoots the minima most of the times. This is because, when it is close to the minima, instead of reaching it, the algorithm alters the parameters by a greater percentage. This leads to overshooting the minima.
মোঃ আরিফুল ইসলাম
Feb 20, 2025