Deceptive Alignment

Learned subsystem that optimizes its own objective.

Maintaining alignment under new conditions.

Willingness of system to accept correction or shutdown.

Using limited human feedback to guide large models.

Tendency for agents to pursue resources regardless of final goal.

Model optimizes objectives misaligned with human values.

Correctly specifying goals.

Ensuring learned behavior matches intended objective.