Exploration-Exploitation Tradeoff

Continuous cycle of observation, reasoning, action, and feedback.

Models trained to decide when to call tools.

Separates planning from execution in agent architectures.

Extending agents with long-term memory stores.

Optimizing policies directly via gradient ascent on expected reward.

Combines value estimation (critic) with policy learning (actor).

Learning from data generated by a different policy.

Learning only from current policy’s data.