Value Misalignment

Correctly specifying goals.

Ensuring learned behavior matches intended objective.

Model behaves well during training but not deployment.

Learned subsystem that optimizes its own objective.

Ensuring AI systems pursue intended human goals.

Model exploits poorly specified objectives.

Maximizing reward without fulfilling real goal.

Tendency for agents to pursue resources regardless of final goal.