Results for "learning rate"

Learning Rate

Intermediate

Controls the size of parameter updates; too high diverges, too low trains slowly or gets stuck.

Think of the learning rate as the size of your steps when walking towards a destination. If you take giant steps, you might overshoot and miss your goal, but if you take tiny steps, you might take forever to get there. In machine learning, the learning rate controls how big of a change we make to...

AdvertisementAd space — search-top

348 results

Algorithmic Bias Intermediate

Unequal performance across demographic groups.

AI in Healthcare
Dataset Shift Intermediate

Differences between training and deployed patient populations.

AI in Healthcare
Predictive Policing Intermediate

AI predicting crime patterns (highly controversial).

AI in Law
Sentencing Algorithm Intermediate

Models estimating recidivism risk.

AI in Law
Case Outcome Prediction Intermediate

Predicting case success probabilities.

AI in Law
High-Frequency Trading Intermediate

Ultra-low-latency algorithmic trading.

AI Economics & Strategy
Fair Lending Intermediate

Ensuring models comply with lending fairness laws.

AI Economics & Strategy
Credit Scoring Intermediate

Predicting borrower default risk.

AI Economics & Strategy
Materials Discovery Advanced

AI discovering new compounds/materials.

AI in Science
Automated Hypothesis Generation Advanced

AI proposing scientific hypotheses.

AI in Science
Competitive Game Advanced

Agents have opposing objectives.

Agents & Autonomy
Surrogate Model Advanced

Fast approximation of costly simulations.

AI in Science
Power-Seeking Behavior Advanced

Tendency to gain control/resources.

AI Safety & Alignment
Self-Model Frontier

Internal representation of the agent itself.

AGI & General Intelligence
Model Release Control Intermediate

Restricting distribution of powerful models.

Governance & Ethics
Agent Intermediate

A system that perceives state, selects actions, and pursues goals—often combining LLM reasoning with tools and memory.

Agents & Autonomy
Cognitive Architecture Frontier

System-level design for general intelligence.

AGI & General Intelligence
Distillation Intermediate

Training a smaller “student” model to mimic a larger “teacher,” often improving efficiency while retaining performance.

Foundations & Theory

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.