Results for "flat curvature"

A wide basin often correlated with better generalization.

Flat high-dimensional regions slowing training.

Optimization using curvature information; often expensive at scale.

Matrix of curvature information.

A narrow minimum often associated with poorer generalization.

Matrix of second derivatives describing local curvature of loss.

The shape of the loss function over parameter space.

A point where gradient is zero but is neither a max nor min; common in deep nets.