Results for "flat curvature"
Saddle Plateau
Intermediate
Flat high-dimensional regions slowing training.
Second-Order Methods
Intermediate
Optimization using curvature information; often expensive at scale.
Hessian Matrix
Intermediate
Matrix of second derivatives describing local curvature of loss.
Hessian
Advanced
Matrix of curvature information.
Flat Minimum
Intermediate
A wide basin often correlated with better generalization.