When Is Noise Response Universal? Tokenization as the Hidden Variable in Language Models
cs.CL, cs.LG
Submitted: 2026-08-26
Updated: 2026-08-26
Comments: 14 pages, 8 figures
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- The Platonic Representation Hypothesis
- Scaling Laws for Neural Language Models
- Pointer Sentinel Mixture Models
- BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
- Text Embeddings by Weakly-Supervised Contrastive Pre-training
- Emergent Abilities of Large Language Models
- Universal and Transferable Adversarial Attacks on Aligned Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering