Results for "Hessian"
Hessian
AdvancedMatrix of curvature information.
The Hessian is like a map that shows how the steepness of a hill changes as you move around on it. While the gradient tells you which way to go to climb higher, the Hessian gives you a sense of how steep the hill is in different directions. In machine learning, it helps algorithms understand how ...
Hessian Matrix
Intermediate
Matrix of second derivatives describing local curvature of loss.
Hessian
Advanced
Matrix of curvature information.
Second-Order Methods
Intermediate
Optimization using curvature information; often expensive at scale.
Sharp Minimum
Intermediate
A narrow minimum often associated with poorer generalization.
Saddle Point
Intermediate
A point where gradient is zero but is neither a max nor min; common in deep nets.
Flat Minimum
Intermediate
A wide basin often correlated with better generalization.
Saddle Plateau
Intermediate
Flat high-dimensional regions slowing training.