Results for "learning rate"
Learning Rate
IntermediateControls the size of parameter updates; too high diverges, too low trains slowly or gets stuck.
Think of the learning rate as the size of your steps when walking towards a destination. If you take giant steps, you might overshoot and miss your goal, but if you take tiny steps, you might take forever to get there. In machine learning, the learning rate controls how big of a change we make to...
System that independently pursues goals over time.
Number of steps considered in planning.
Simple agent responding directly to inputs.
Increasing model capacity via compute.
Cost to run models in production.
Cost of model training.
Competitive advantage from proprietary models/data.
Models whose weights are publicly available.
Models accessible only via service APIs.
Set of vectors closed under addition and scalar multiplication.
Decomposes a matrix into orthogonal components; used in embeddings and compression.
Measure of vector magnitude; used in regularization and optimization.
Vectors with zero inner product; implies independence.
Number of linearly independent rows or columns.
Sensitivity of a function to input perturbations.
Matrix of first-order derivatives for vector-valued functions.
Matrix of curvature information.
Variable whose values depend on chance.
Describes likelihoods of random variable outcomes.
Average value under a distribution.
Measure of spread around the mean.
Measures joint variability between variables.
Normalized covariance.
Approximating expectations via random sampling.
Sampling from easier distribution with reweighting.
Minimum relative to nearby points.
Lowest possible loss.
Optimization under equality/inequality constraints.
Converts constrained problem to unconstrained form.
Alternative formulation providing bounds.