Results for "curvature"
Second-Order Methods
Intermediate
Optimization using curvature information; often expensive at scale.
Hessian
Advanced
Matrix of curvature information.
Hessian Matrix
Intermediate
Matrix of second derivatives describing local curvature of loss.
Saddle Point
Intermediate
A point where gradient is zero but is neither a max nor min; common in deep nets.
Sharp Minimum
Intermediate
A narrow minimum often associated with poorer generalization.
Flat Minimum
Intermediate
A wide basin often correlated with better generalization.