Schema-Key Wording as an Instruction Channel in Structured Generation under Constrained Decoding

arXiv:2604.14862 · cs.CL, cs.AI · Submitted 2026-04-16 · Read on arXiv

cs.CL, cs.AI

Submitted: 2026-04-16

Updated: 2026-09-16

Comments: Accepted to the Main Conference of AACL-IJCNLP 2026

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 12× in this paper · explained in 2 episodes
• Accuracy — 7× in this paper · explained in 1 episode
• Structural Constraints — 4× in this paper · explained in 2 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Meeting of the Association for Computational Linguistics — 2× in this paper
• Redundancy — 2× in this paper · explained in 2 episodes
• Additivity — 1× in this paper · explained in 1 episode
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Verifier — 1× in this paper · explained in 2 episodes

Sources

• CRANE: Reasoning with constrained LLM generation
• Training Verifiers to Solve Math Word Problems
• XGrammar-2: Dynamic and Efficient Structured Generation Engine for Agentic LLMs
• Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models
• Noise-induced nonreciprocal topological dissipative solitons in directionally coupled chains and lattices
• The Llama 3 Herd of Models
• Qwen2.5-Coder Technical Report
• "We Need Structured Output": Towards User-centered Constraints on Large Language Model Output
• SLOT: Structuring the Output of Large Language Models
• The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding
• Efficient Guided Generation for Large Language Models
• Qwen2.5 Technical Report
• Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models
• The Price of Format: Diversity Collapse in LLMs
• Thinking Before Constraining: A Unified Decoding Framework for Large Language Models
• Instruction-Following Evaluation for Large Language Models
• Flexible and Efficient Grammar-Constrained Decoding

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering