Results for "feedback"

Feedback

Intermediate

Using output to adjust future inputs.

Feedback is like getting a report card after a test. If you did well, you might keep studying the same way, but if you didn't, you would change your study habits. In systems like a thermostat, feedback helps maintain the right temperature: if it gets too cold, the heater gets turned on, and if it...

AdvertisementAd space — search-top

45 results

Agent Loop Intermediate

Continuous cycle of observation, reasoning, action, and feedback.

AI Economics & Strategy
Control Loop Advanced

Continuous loop adjusting actions based on state feedback.

Robotics & Embodied AI
Feedback Loop Intermediate

Using production outcomes to improve models.

MLOps & Infrastructure
Closed-Loop Control Advanced

Control using real-time sensor feedback.

Robotics & Embodied AI
Feedback Intermediate

Using output to adjust future inputs.

Foundations & Theory
Feedback Amplification Advanced

AI reinforcing market trends.

Agents & Autonomy
RLHF Intermediate

Reinforcement learning from human feedback: uses preference data to train a reward model and optimize the policy.

Optimization
Scalable Oversight Advanced

Using limited human feedback to guide large models.

AI Safety & Alignment
Feedback Loop Collapse Intermediate

Model trained on its own outputs degrades quality.

Model Failure Modes
Self-Reflection Intermediate

Models evaluating and improving their own outputs.

AI Economics & Strategy
Open-Loop Control Advanced

Control without feedback after execution begins.

Robotics & Embodied AI
System Dynamics Advanced

Equations governing how system states change over time.

Dynamics & Physics
Sparse Reward Advanced

Reward only given upon task completion.

Reinforcement Learning
Teleoperation Frontier

Human controlling robot remotely.

World Models & Cognition
Sensorimotor Loop Advanced

Closed loop linking sensing and acting.

Agents & Autonomy
Reinforcement Learning Intermediate

A learning paradigm where an agent interacts with an environment and learns to choose actions to maximize cumulative reward.

Reinforcement Learning
Online Learning Intermediate

Learning where data arrives sequentially and the model updates continuously, often under changing distributions.

Machine Learning
Reward Model Intermediate

Model trained to predict human preferences (or utility) for candidate outputs; used in RLHF-style pipelines.

Foundations & Theory
Alignment Intermediate

Ensuring model behavior matches human goals, norms, and constraints, including reducing harmful or deceptive outputs.

Foundations & Theory
Human-in-the-Loop Intermediate

System design where humans validate or guide model outputs, especially for high-stakes decisions.

Foundations & Theory
Actor-Critic Intermediate

Combines value estimation (critic) with policy learning (actor).

AI Economics & Strategy
Emergent Coordination Intermediate

Coordination arising without explicit programming.

AI Economics & Strategy
Shadow Deployment Intermediate

Running new model alongside production without user impact.

MLOps & Infrastructure
Canary Release Intermediate

Incrementally deploying new models to reduce risk.

MLOps & Infrastructure
Data Drift Intermediate

Shift in feature distribution over time.

MLOps & Infrastructure
Prediction Drift Intermediate

Shift in model outputs.

MLOps & Infrastructure
Corrigibility Advanced

Willingness of system to accept correction or shutdown.

AI Safety & Alignment
Constraint Prompting Intro

Explicit output constraints (format, tone).

Prompting & Instructions
Embodied AI Advanced

AI systems that perceive and act in the physical world through sensors and actuators.

Robotics & Embodied AI
Actuator Advanced

Hardware components that execute physical actions.

Robotics & Embodied AI

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.