x-Risk

Rate at which AI capabilities improve.

Sudden jump to superintelligence.

Incremental capability growth.

Stored compute or algorithms enabling rapid jumps.

Maintaining alignment under new conditions.

Willingness of system to accept correction or shutdown.

Using limited human feedback to guide large models.

Risk threatening humanity’s survival.