CORE-T: COherent REtrieval of Tables for Text-to-SQL
cs.CL, cs.AI, cs.IR
Submitted: 2026-01-19
Updated: 2026-08-30
Comments: Accepted at EMNLP Main 2026. Camera-ready version with revisions following peer review. Code and data available at: https://github.com/UKPLab/emnlp2026-core-t
Code: https://github.com/UKPLab/emnlp2026-core-t
License: http://creativecommons.org/licenses/by/4.0/
The gist: Realistic text-to-SQL workflows often require joining multiple tables.
Terminology
Abstract
Realistic text-to-SQL workflows often require joining multiple tables. As a result, accurately retrieving the relevant set of tables becomes a key bottleneck for end-to-end performance. We study an open-book setting where queries must be answered over large, heterogeneous table collections pooled from many sources, without clean scoping signals such as database identifiers. Here, dense retrieval (DR) achieves high recall but returns many distractors, while join-aware alternatives often rely on extra assumptions and/or incur high inference overhead. We propose CORE-T, a scalable, training-free framework that enriches tables with LLM-generated purpose metadata and pre-computes a lightweight table-compatibility cache. At inference time, DR returns top-K candidates; a single LLM call selects a coherent, joinable subset, and a two-step additive adjustment stage restores strongly compatible tables. Across Bird, Spider, MMQA, and Beaver, CORE-T improves over DR by up to 22.7 points in table-selection F1 while returning up to 40% fewer tables, and by up to 24.4 points in multi-table execution accuracy, and uses 1.64-4.20x fewer total selection tokens than LLM-intensive baselines.
Sources
- REaR: Retrieve, Expand and Refine for Effective Multitable Retrieval
- The Llama 3 Herd of Models
- Qwen2.5 Technical Report
- Arctic-Embed 2.0: Multilingual Retrieval Without Compromise
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering