The AI-Enabled Scientific Frontier

arXiv:2609.16258 · cs.AI, cs.LG, cs.PF, econ.GN, q-fin.EC · Submitted 2026-09-14 · Read on arXiv

cs.AI, cs.LG, cs.PF, econ.GN, q-fin.EC

Submitted: 2026-09-14

Updated: 2026-09-14

Code: https://github.com/karpathy/autoresearch

License: http://creativecommons.org/licenses/by/4.0/

The gist: As artificial intelligence's capabilities improve, it is increasingly viewed as a general scientific method.

Terminology

Abstract

As artificial intelligence's capabilities improve, it is increasingly viewed as a general scientific method. But how true are these claims? Does AI outperform all techniques, or only some, and how is this changing? To assess the claims, we assemble a corpus of 2,507 head-to-head comparisons between AI and other scientific analysis techniques across 27 scientific disciplines from papers published between 2000 and early 2025. We find a profound dichotomy. Relative to traditional statistics, AI often outperforms, but at a significantly higher computational cost. But there are also nearly a quarter of cases where AI is both more expensive and performs worse than traditional statistical techniques and this fraction has been stable for a decade. Relative to scientific computing, AI often underperforms, but at lower computational cost. This has begun to change: since 2020, AI's performance against scientific computing has notably strengthened and it now outperforms on more than half of comparisons. These patterns suggest that AI is therefore not a universal replacement for existing methods, but rather a valuable -- and improving -- part of a new AI-enabled scientific frontier.

Sources

Related papers