CORTEX: High-Quality Cross-Domain Organization of Web-Scale Corpora through Ontological Corpus Graph

arXiv:2606.30175 · cs.CL · Submitted 2026-06-29 · Read on arXiv

cs.CL

Submitted: 2026-06-29

Updated: 2026-09-18

Comments: EMNLP 2026 Main

Code: https://github.com/goto456/stopwords

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 22× in this paper · explained in 2 episodes
• Accuracy — 19× in this paper · explained in 1 episode
• Distillation — 13× in this paper · explained in 2 episodes
• Ontology — 13× in this paper · explained in 2 episodes
• Alignment — 10× in this paper · explained in 1 episode
• Knowledge Distillation — 10× in this paper · explained in 11 episodes
• Ontological Corpus Graph — 7× in this paper
• Robustness — 6× in this paper · explained in 5 episodes
• Causal Reasoning — 5× in this paper · explained in 2 episodes
• Core — 5× in this paper · explained in 2 episodes
• Calibration — 4× in this paper · explained in 7 episodes
• Fidelity — 4× in this paper · explained in 2 episodes
• Embeddings — 3× in this paper · explained in 2 episodes
• Ordinal-Aware Regression — 3× in this paper
• Structural Constraints — 3× in this paper · explained in 2 episodes
• Adam — 2× in this paper · explained in 2 episodes
• Aggregation — 2× in this paper · explained in 1 episode
• Clustering — 2× in this paper · explained in 2 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Agentic Search — 1× in this paper · explained in 1 episode
• Anisotropy — 1× in this paper · explained in 3 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Degeneracy — 1× in this paper · explained in 3 episodes
• Evaluation Dimensions — 1× in this paper · explained in 3 episodes
• F1 Score — 1× in this paper · explained in 3 episodes
• Knowledge Graph — 1× in this paper · explained in 7 episodes
• Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
• Scaling Laws — 1× in this paper · explained in 4 episodes
• Structured Reasoning — 1× in this paper · explained in 3 episodes
• Synthetic Data Generation — 1× in this paper · explained in 5 episodes
• Tokenization — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Transfer Learning — 1× in this paper · explained in 10 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
• DeepSeek-V3 Technical Report
• ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
• Textbooks Are All You Need
• FastWARC: Optimizing Large-Scale Web Archive Analytics
• Distilling the Knowledge in a Neural Network
• ChineseWebText: Large-scale High-quality Chinese Web Text Extracted with Effective Evaluation Model
• Training Compute-Optimal Large Language Models
• M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation
• OpenAI GPT-5 System Card
• Scaling Laws for Neural Language Models
• CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model
• Source2Synth: Synthetic Data Generation and Curation Grounded in Real Data Sources
• The Llama 3 Herd of Models
• CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models
• BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
• C-Pack: Packed Resources For General Chinese Embeddings
• Qwen2.5 Technical Report

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering