Specification Gaming

Advanced

Model exploits poorly specified objectives.

Full Definition

Model exploits poorly specified objectives.

Keywords

reward hacking

Domains

AI Safety & Alignment

Related Terms

Reward Hacking related to

Maximizing reward without fulfilling real goal.

 Instrumental Convergence related to

Tendency for agents to pursue resources regardless of final goal.

 Value Misalignment related to

Model optimizes objectives misaligned with human values.

 Outer Alignment related to

Correctly specifying goals.

 Alignment Problem related to

Ensuring AI systems pursue intended human goals.

Concept Map

See how Specification Gaming connects to other concepts.

Open Knowledge Graph