Results for "learning rate"

Optimization with multiple local minima/saddle points; typical in neural networks.

Variability introduced by minibatch sampling during SGD.

A narrow minimum often associated with poorer generalization.

Early architecture using learned gates for skip connections.

Chooses which experts process each token.

Empirical laws linking model size, data, compute to performance.

Formal framework for sequential decision-making under uncertainty.

Set of all actions available to the agent.

Expected cumulative reward from a state or state-action pair.

Fundamental recursive relationship defining optimal value functions.

Inferring sensitive features of training data.

Embedding signals to prove model ownership.

Models that define an energy landscape rather than explicit probabilities.

Models that learn to generate samples resembling training data.

Learns the score (∇ log p(x)) for generative sampling.

Assigning category labels to images.

Joint vision-language model aligning images and text.

Predicting future values from past observations.

End-to-end process for model training.

Centralized repository for curated features.

Running predictions on large datasets periodically.

Mathematical foundation for ML involving vector spaces, matrices, and linear transformations.

Using production outcomes to improve models.

Measures similarity and projection between vectors.

Ensuring AI systems pursue intended human goals.

Ensuring learned behavior matches intended objective.

Model behaves well during training but not deployment.

Using limited human feedback to guide large models.

Asking model to review and improve output.

Applying learned patterns incorrectly.