Results for "learning rate"

Learning Rate

Intermediate

Controls the size of parameter updates; too high diverges, too low trains slowly or gets stuck.

Think of the learning rate as the size of your steps when walking towards a destination. If you take giant steps, you might overshoot and miss your goal, but if you take tiny steps, you might take forever to get there. In machine learning, the learning rate controls how big of a change we make to...

AdvertisementAd space — search-top

348 results

Learning Rate Schedule Intermediate

Adjusting learning rate over training to improve convergence.

AI Economics & Strategy
Learning Rate Intermediate

Controls the size of parameter updates; too high diverges, too low trains slowly or gets stuck.

Foundations & Theory
Warmup Intermediate

Gradually increasing learning rate at training start to avoid divergence.

AI Economics & Strategy
ROC Curve Intermediate

Plots true positive rate vs false positive rate across thresholds; summarizes separability.

Foundations & Theory
Takeoff Speed Advanced

Rate at which AI capabilities improve.

AI Safety & Alignment
Gradient Descent Intermediate

Iterative method that updates parameters in the direction of negative gradient to minimize loss.

Optimization
Adaptive Optimization Intermediate

Methods like Adam adjusting learning rates dynamically.

Foundations & Theory
Sensitivity Intermediate

Ability to correctly detect disease.

AI in Healthcare
False Negative Intermediate

Failure to detect present disease.

AI in Healthcare
AI Adoption Curve Intermediate

Organizational uptake of AI technologies.

AI Economics & Strategy
Throughput Ceiling Intermediate

Maximum system processing rate.

AI Economics & Strategy
Simpson’s Paradox Advanced

Trend reversal when data is aggregated improperly.

Causal AI & Interpretability
PAC Learning Intermediate

A model is PAC-learnable if it can, with high probability, learn an approximately correct hypothesis from finite samples.

AI Economics & Strategy
Hyperparameters Intermediate

Configuration choices not learned directly (or not typically learned) that govern training or architecture.

Optimization
Stochastic Gradient Descent Intermediate

A gradient method using random minibatches for efficient training on large datasets.

Foundations & Theory
Spurious Correlation Intermediate

Model relies on irrelevant signals.

Model Failure Modes
Momentum Intermediate

Uses an exponential moving average of gradients to speed convergence and reduce oscillation.

Optimization
Throughput Intermediate

How many requests or tokens can be processed per unit time; affects scalability and cost.

Transformers & LLMs
Speech Recognition Intermediate

Converting audio speech into text, often using encoder-decoder or transducer architectures.

Speech & Audio AI
Gradient Advanced

Direction of steepest ascent of a function.

Mathematics
Recall Intermediate

Of true positives, the fraction correctly identified; sensitive to false negatives.

Foundations & Theory
Specificity Intermediate

Of true negatives, the fraction correctly identified.

Foundations & Theory
PID Controller Intermediate

Classical controller balancing responsiveness and stability.

Foundations & Theory
Friction Model Advanced

Mathematical representation of friction forces.

Dynamics & Physics
Alpha Intermediate

Returns above benchmark.

AI Economics & Strategy
Curriculum Learning Intermediate

Ordering training samples from easier to harder to improve convergence or generalization.

Foundations & Theory
Active Learning Intermediate

Selecting the most informative samples to label (e.g., uncertainty sampling) to reduce labeling cost.

Foundations & Theory
Off-Policy Learning Intermediate

Learning from data generated by a different policy.

AI Economics & Strategy
Supervised Learning Intermediate

Learning a function from input-output pairs (labeled data), optimizing performance on predicting outputs for unseen inputs.

Machine Learning
Imitation Learning Advanced

Learning policies from expert demonstrations.

Reinforcement Learning

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.