Instrumental Convergence

Advanced

Tendency for agents to pursue resources regardless of final goal.

Full Definition

Tendency for agents to pursue resources regardless of final goal.

Keywords

power-seeking

Domains

AI Safety & Alignment

Related Terms

Value Misalignment related to

Model optimizes objectives misaligned with human values.

 Outer Alignment related to

Correctly specifying goals.

 Inner Alignment related to

Ensuring learned behavior matches intended objective.

 Deceptive Alignment related to

Model behaves well during training but not deployment.

 Alignment Problem related to

Ensuring AI systems pursue intended human goals.

 Specification Gaming related to

Model exploits poorly specified objectives.

 Reward Hacking related to

Maximizing reward without fulfilling real goal.

Concept Map

See how Instrumental Convergence connects to other concepts.

Open Knowledge Graph