The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

arXiv:2603.18482 · cs.CL, cs.LG, stat.ML · Submitted 2026-03-19 · Read on arXiv

cs.CL, cs.LG, stat.ML

Submitted: 2026-03-19

Updated: 2026-09-23

Code: https://github.com/EstebanGarces/human_vs_machine

Terminology

• AUC — 77× in this paper · explained in 2 episodes
• Transformer — 18× in this paper · explained in 2 episodes
• Alignment — 9× in this paper · explained in 1 episode
• Benchmark — 7× in this paper · explained in 2 episodes
• Naive Bayes — 7× in this paper
• Lexical Diversity — 6× in this paper · explained in 2 episodes
• Accuracy — 5× in this paper · explained in 1 episode
• Perplexity — 4× in this paper · explained in 3 episodes
• Trace — 4× in this paper · explained in 2 episodes
• Calibration — 3× in this paper · explained in 7 episodes
• Generalization — 3× in this paper · explained in 13 episodes
• Transformer Architecture — 3× in this paper · explained in 2 episodes
• alpha — 3× in this paper · explained in 1 episode
• Munich Center for Machine Learning — 2× in this paper
• Robustness — 2× in this paper · explained in 5 episodes
• Transformer Models — 2× in this paper · explained in 2 episodes
• Benchmarking — 1× in this paper · explained in 3 episodes
• Core — 1× in this paper · explained in 2 episodes
• Empirical Methods in Natural Language Processing — 1× in this paper
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Homogeneity — 1× in this paper · explained in 2 episodes
• Instruction Tuning — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Model-Agnostic — 1× in this paper · explained in 2 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Tokenization — 1× in this paper · explained in 2 episodes

Sources

• Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity
• DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
• Closing the Curious Case of Neural Text Degeneration
• GLTR: Statistical Detection and Visualization of Generated Text
• The Llama 3 Herd of Models
• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
• Mistral 7B
• Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
• Falcon2-11B Technical Report
• Pointer Sentinel Mixture Models
• Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputs
• Automatic Detection of Machine Generated Text: A Critical Survey
• Release Strategies and the Social Impacts of Language Models
• Contrastive Search Is What You Need For Neural Text Generation
• A Contrastive Framework for Neural Text Generation
• Qwen2 Technical Report
• OPT: Open Pre-trained Transformer Language Models
• Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering