Robust Alignment

Willingness of system to accept correction or shutdown.

Using limited human feedback to guide large models.

Risk threatening humanity’s survival.

Existential risk from AI systems.

Correctly specifying goals.

Ensuring learned behavior matches intended objective.

Model behaves well during training but not deployment.

Learned subsystem that optimizes its own objective.