Results for "model-based"

Model-Based RL

Advanced

RL using learned or known environment models.

Model-based reinforcement learning is like having a map while exploring a new city. Instead of wandering around aimlessly, you can look at the map to plan your route and make better decisions about where to go next. In this type of learning, an AI agent first learns how the environment works—like...

AdvertisementAd space — search-top

405 results

Semi-Supervised Learning Intermediate

Training with a small labeled dataset plus a larger unlabeled dataset, leveraging assumptions like smoothness/cluster structure.

Machine Learning
Weight Initialization Intermediate

Methods to set starting weights to preserve signal/gradient scales across layers.

Foundations & Theory
Curriculum Learning Intermediate

Ordering training samples from easier to harder to improve convergence or generalization.

Foundations & Theory
Instance Segmentation Intermediate

Pixel-level separation of individual object instances.

Computer Vision
Synthetic Data Intermediate

Artificially created data used to train/test models; helpful for privacy and coverage, risky if unrealistic.

Foundations & Theory
Forecasting Intermediate

Predicting future values from past observations.

Time Series
Graph Convolution Intermediate

Extension of convolution to graph domains using adjacency structure.

Model Architectures
Deliberative Agent Advanced

Agent reasoning about future outcomes.

Agents & Autonomy
Kalman Filter Intermediate

Optimal estimator for linear dynamic systems.

Time Series
Exposure Bias Intermediate

Differences between training and inference conditions.

Model Failure Modes
Open-Loop Control Advanced

Control without feedback after execution begins.

Robotics & Embodied AI
Mental Simulation Frontier

Imagined future trajectories.

World Models & Cognition
Risk Stratification Intermediate

Grouping patients by predicted outcomes.

AI in Healthcare
Fair Lending Intermediate

Ensuring models comply with lending fairness laws.

AI Economics & Strategy
Credit Scoring Intermediate

Predicting borrower default risk.

AI Economics & Strategy
Alpha Intermediate

Returns above benchmark.

AI Economics & Strategy
Market Impact Advanced

Effect of trades on prices.

Agents & Autonomy
Information Cascades Advanced

Early signals disproportionately influence outcomes.

Dynamics & Physics
State Estimation Advanced

Inferring the agent’s internal state from noisy sensor data.

Robotics & Embodied AI
Machine Learning Intermediate

A subfield of AI where models learn patterns from data to make predictions or decisions, improving with experience rather than explicit rule-coding.

Machine Learning
Embedding Intermediate

A continuous vector encoding of an item (word, image, user) such that semantic similarity corresponds to geometric closeness.

Machine Learning
Attention Intermediate

Mechanism that computes context-aware mixtures of representations; scales well and captures long-range dependencies.

Transformers & LLMs
LSTM Intermediate

An RNN variant using gates to mitigate vanishing gradients and capture longer context.

Foundations & Theory
Vector Database Intermediate

A datastore optimized for similarity search over embeddings, enabling semantic retrieval at scale.

Large Language Models
A/B Testing Intermediate

Controlled experiment comparing variants by random assignment to estimate causal effects of changes.

Foundations & Theory
Beam Search Intermediate

Search algorithm for generation that keeps top-k partial sequences; can improve likelihood but reduce diversity.

Foundations & Theory
Planning Intermediate

Methods for breaking goals into steps; can be classical (A*, STRIPS) or LLM-driven with tool calls.

Foundations & Theory
Gradient Clipping Intermediate

Limiting gradient magnitude to prevent exploding gradients.

AI Economics & Strategy
NLP Intermediate

AI subfield dealing with understanding and generating human language, including syntax, semantics, and pragmatics.

Foundations & Theory
Policy Intermediate

Strategy mapping states to actions.

AI Economics & Strategy

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.