From AGI to ASI
cs.AI, cs.CY, cs.LG
Submitted: 2026-06-10
Updated: 2026-08-30
Comments: v2: minor fixes and addition of related work
License: http://creativecommons.org/licenses/by/4.0/
The gist: Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations.
Terminology
Abstract
Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations. Achieving this goal would have profound and far-reaching impacts on human society, which raises many complex questions for the decade ahead. This report investigates how AI itself might continue to develop in a post-AGI world along the continuum of machine intelligence. The endpoint of this continuum, Universal AI, is theoretically well understood, which provides some formal grounding for the main focus of this report: the transition from human-level AGI to artificial general superintelligence, which can intuitively be understood as a system that is more intelligent and cognitively capable than large organisations of humans. After characterizing ASI, the report discusses four potential pathways from AGI to ASI: scaling AGI, AI paradigm shifts, recursive improvement, and ASI emerging from large-scale multi-agent collectives. The report then discusses possible frictions and bottlenecks along these pathways. Determining whether the impact of these frictions will be negligible or substantial raises a number of concrete open research questions. Due to large uncertainties for predicting ASI progress, it cannot be ruled out that AI progress might continue to accelerate over the next years. This could imply that the image of a single transformative step change, caused by the introduction of human-level AGI into our society, could be inaccurate. More apt might be the prospect of a series of transformative societal changes caused by AI-enabled progress and breakthroughs across many areas of science and technology. Preparing for this prospect requires a massively interdisciplinary endeavour of global scope and interest.
Sources
- Frontier AI Regulation: Managing Emerging Risks to Public Safety
- Good and safe uses of AI Oracles
- Constitutional AI: Harmlessness from AI Feedback
- International Scientific Report on the Safety of Advanced AI (Interim Report)
- Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?
- International AI Safety Report
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
- Measuring AI R&D Automation
- On the Measure of Intelligence
- Supervising strong learners by amplifying weak experts
- The Efficiency Spectrum of Large Language Models: An Algorithmic Survey
- Algorithmic progress in computer vision
- Explosive growth from AI automation: A review of the arguments
- GATE: An Integrated Assessment Model for AI Automation
- Reflective Oracles: A Foundation for Classical Game Theory
- The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- Logical Induction
- Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
- FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
- Neural Turing Machines
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection