Results for "optimization duality"
Convex Optimization
Intermediate
Optimization problems where any local minimum is global.
Non-Convex Optimization
Intermediate
Optimization with multiple local minima/saddle points; typical in neural networks.
Constrained Optimization
Intermediate
Optimization under equality/inequality constraints.
Loss Function
Intermediate
A function measuring prediction error (and sometimes calibration), guiding gradient-based optimization.
Second-Order Methods
Intermediate
Optimization using curvature information; often expensive at scale.
Norm
Advanced
Measure of vector magnitude; used in regularization and optimization.
Objective Surface
Intermediate
Visualization of optimization landscape.
Stochastic Approximation
Intermediate
Optimization under uncertainty.
Adaptive Optimization
Intermediate
Methods like Adam adjusting learning rates dynamically.
Trajectory Optimization
Advanced
Optimizing continuous action sequences.