DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling

arXiv:2604.06474 · cs.CL · Submitted 2026-04-07 · Read on arXiv

cs.CL

Submitted: 2026-04-07

Updated: 2026-08-26

Terminology

• Benchmark — 27× in this paper · explained in 2 episodes
• Actor — 22× in this paper · explained in 3 episodes
• Consistency — 10× in this paper · explained in 3 episodes
• Exploratory Data Analysis — 10× in this paper
• Large Language Model — 10× in this paper
• Core — 8× in this paper · explained in 2 episodes
• Accountability — 7× in this paper · explained in 2 episodes
• Grounding — 4× in this paper · explained in 3 episodes
• Text-to-SQL — 4× in this paper · explained in 3 episodes
• Agentic System — 3× in this paper · explained in 2 episodes
• Benchmarking — 3× in this paper · explained in 3 episodes
• Large Language Model (LLM) — 2× in this paper · explained in 3 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Adam — 1× in this paper · explained in 2 episodes
• Agentic Loop — 1× in this paper · explained in 1 episode
• Aggregation — 1× in this paper · explained in 1 episode
• Annotation Errors — 1× in this paper · explained in 1 episode
• Causal Reasoning — 1× in this paper · explained in 2 episodes
• Commentary — 1× in this paper · explained in 2 episodes
• Cooperation — 1× in this paper · explained in 2 episodes
• In-Context Learning — 1× in this paper · explained in 4 episodes
• LLM judge — 1× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
• Model Context Protocol (MCP) — 1× in this paper · explained in 8 episodes
• Multi-Agent Framework — 1× in this paper · explained in 3 episodes
• Pairwise Comparisons — 1× in this paper · explained in 2 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• The Case of the Mysterious Citations
• ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration
• DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
• ConDABench: Interactive Evaluation of Language Models for Data Analysis
• Deep Research Bench: Evaluating AI Web Research Agents
• SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL
• WebThinker: Empowering Large Reasoning Models with Deep Research Capability
• Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models
• DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis
• DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
• DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
• FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
• OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking
• TablePilot: Recommending Human-Preferred Tabular Data Analysis with Large Language Models
• DataSciBench: An LLM Agent Benchmark for Data Science
• DeepAnalyze: Agentic Large Language Models for Autonomous Data Science
• InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering