Line Search

Intermediate

Choosing step size along gradient direction.

Full Definition

Choosing step size along gradient direction.

Keywords

step optimization

Domains

Foundations & Theory

Related Terms

Trust Region related to

Restricting updates to safe regions.

 Constrained Optimization related to

Optimization under equality/inequality constraints.

 Lagrangian related to

Converts constrained problem to unconstrained form.

 Dual Problem related to

Alternative formulation providing bounds.

 Objective Surface related to

Visualization of optimization landscape.

 Local Minimum related to

Minimum relative to nearby points.

 Global Minimum related to

Lowest possible loss.

 Saddle Plateau related to

Flat high-dimensional regions slowing training.

Concept Map

See how Line Search connects to other concepts.

Open Knowledge Graph