Corrigibility

Using limited human feedback to guide large models.

Risk threatening humanity’s survival.

Existential risk from AI systems.

Rate at which AI capabilities improve.

Ensuring learned behavior matches intended objective.

Model behaves well during training but not deployment.

Learned subsystem that optimizes its own objective.

Maintaining alignment under new conditions.