Frontier Lag: A Bibliometric Audit of Capability Misrepresentation in Academic AI Evaluation

arXiv:2605.04135 · cs.CY, cs.AI, cs.CL · Submitted 2026-05-05 · Read on arXiv

cs.CY, cs.AI, cs.CL

Submitted: 2026-05-05

Updated: 2026-09-30

Project page: https://davidgringras.github.io/safety-under-scaffolding

Terminology

Benchmark — 73× in this paper · explained in 2 episodes
Admissibility — 30× in this paper · explained in 2 episodes
Scaffolding — 29× in this paper · explained in 3 episodes
Accuracy — 18× in this paper · explained in 1 episode
Ablation — 16× in this paper · explained in 1 episode
Core — 10× in this paper · explained in 2 episodes
Adam — 5× in this paper · explained in 2 episodes
Consistency — 4× in this paper · explained in 3 episodes
Epoch AI Capabilities Index — 4× in this paper
Failure Modes — 4× in this paper · explained in 3 episodes
Aggregation — 3× in this paper · explained in 1 episode
Clustering — 3× in this paper · explained in 2 episodes
Self-consistency — 3× in this paper · explained in 2 episodes
Decoupling — 2× in this paper · explained in 2 episodes
Foundation Model — 2× in this paper · explained in 3 episodes
International Conference on Learning Representations — 2× in this paper
Model Evaluation and Threat Research — 2× in this paper
RAG — 2× in this paper · explained in 3 episodes
Robustness — 2× in this paper · explained in 5 episodes
Steering — 2× in this paper · explained in 2 episodes
Trace — 2× in this paper · explained in 2 episodes
Adaptation — 1× in this paper · explained in 1 episode
Agent Harness — 1× in this paper · explained in 2 episodes
Agentic Task — 1× in this paper · explained in 1 episode
Agentic Tasks — 1× in this paper · explained in 1 episode
Alignment — 1× in this paper · explained in 1 episode
Benchmarking — 1× in this paper · explained in 3 episodes
Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
Generalization — 1× in this paper · explained in 13 episodes
Hallucination — 1× in this paper · explained in 3 episodes
Interpretability — 1× in this paper · explained in 15 episodes
Provenance — 1× in this paper · explained in 3 episodes
Selection Bias — 1× in this paper · explained in 4 episodes
Transformer — 1× in this paper · explained in 2 episodes
Two-Stage Architecture — 1× in this paper · explained in 2 episodes
Verification — 1× in this paper · explained in 2 episodes
alpha — 1× in this paper · explained in 1 episode

Sources

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?

Terminology

Sources

Related papers