Results for "belief divergence"

AdvertisementAd space — search-top

25 results

KL Divergence Intermediate

Measures how one probability distribution diverges from another.

AI Economics & Strategy
Posterior Distribution Advanced

Updated belief after observing data.

Probability & Statistics
Restricted Boltzmann Machine Intermediate

Simplified Boltzmann Machine with bipartite structure.

Model Architectures
Exploding Gradient Intermediate

Gradients grow too large, causing divergence; mitigated by clipping, normalization, careful init.

Foundations & Theory
Warmup Intermediate

Gradually increasing learning rate at training start to avoid divergence.

AI Economics & Strategy
Exposure Bias Intermediate

Differences between training and inference conditions.

Model Failure Modes
Factor Graph Intermediate

Graphical model expressing factorization of a probability distribution.

Model Architectures
Prior Distribution Advanced

Belief before observing data.

Probability & Statistics
Object Permanence Frontier

Understanding objects exist when unseen.

World Models & Cognition
State Estimation Advanced

Inferring the agent’s internal state from noisy sensor data.

Robotics & Embodied AI
Gradient Descent Intermediate

Iterative method that updates parameters in the direction of negative gradient to minimize loss.

Optimization
Cross-Entropy Intermediate

Measures divergence between true and predicted probability distributions.

AI Economics & Strategy
Boltzmann Machine Intermediate

Probabilistic energy-based neural network with hidden variables.

Model Architectures
Score-Based Model Advanced

Learns the score (∇ log p(x)) for generative sampling.

Diffusion & Generative Models
Diffusion Model Advanced

Generative model that learns to reverse a gradual noise process.

Diffusion & Generative Models
Variational Autoencoder Advanced

Autoencoder using probabilistic latent variables and KL regularization.

Diffusion & Generative Models
Mode Collapse Advanced

Generator produces limited variety of outputs.

Diffusion & Generative Models
Data Drift Intermediate

Shift in feature distribution over time.

MLOps & Infrastructure
Condition Number Advanced

Sensitivity of a function to input perturbations.

Mathematics
Value Misalignment Advanced

Model optimizes objectives misaligned with human values.

AI Safety & Alignment
Shadow AI Intermediate

AI used without governance approval.

Governance & Ethics
Sim-to-Real Gap Advanced

Performance drop when moving from simulation to reality.

Simulation & Sim-to-Real
Imitation Learning Advanced

Learning policies from expert demonstrations.

Reinforcement Learning
Polarization Advanced

Groups adopting extreme positions.

Dynamics & Physics
Distillation Intermediate

Training a smaller “student” model to mimic a larger “teacher,” often improving efficiency while retaining performance.

Foundations & Theory

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.