When Summaries Distort Decisions: Information Fidelity in LLM-Compressed Financial Analysis
cs.AI, q-fin.CP
Submitted: 2026-06-28
Updated: 2026-09-17
Comments: EMNLP 2026 Industry Track
License: http://creativecommons.org/licenses/by/4.0/
The gist: Financial decision-makers face more information than they can directly inspect, making context compression necessary.
Terminology
Abstract
Financial decision-makers face more information than they can directly inspect, making context compression necessary. Yet when large language models (LLMs) compress financial source material, they can alter the investment judgment supported by the original source. We frame this problem as information fidelity: compression loses fidelity when it changes the decision induced by the source. In agentic systems, such losses may recur across intermediate steps and amplify throughout the decision process. Across financial filings and earnings-call transcripts, we find that LLM-based compression can produce fluent and factually plausible compressed contexts that nevertheless alter downstream decisions. We analyze two diagnostic patterns associated with fidelity loss: decontextualization, where salient evidence is retained but separated from the caveats and contextual qualifiers needed for correct interpretation, and model dependency, where different compressors expose different views of the same source. We then propose Agentic Context Compression, which generates multiple candidate compressions and audits their disagreements against the original source. Our results suggest that financial compression should be evaluated not only by efficiency or factuality, but also by its ability to preserve decision-relevant context.
Sources
- Faithful Summarisation under Disagreement via Belief-Level Aggregation
- Quantifying Cognitive Bias Induction in LLM-Generated Content
- Assessing Look-Ahead Bias in Stock Return Predictions Generated By GPT Sentiment Analysis
- Molecular Facts: Desiderata for Decontextualization in LLM Fact Verification
- FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
- ACON: Optimizing Context Compression for Long-horizon LLM Agents
- Evaluating LLMs in Finance Requires Explicit Bias Consideration
- Document Summarization with Conformal Importance Guarantees
- LLMs Corrupt Your Documents When You Delegate
- Understanding and Improving Information Preservation in Prompt Compression for LLMs
- Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction
- Spot the BlindSpots: Systematic Identification and Quantification of Fine-Grained LLM Biases in Contact Center Summaries
- MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs
- Frame In, Frame Out: Measuring Framing Bias in LLM-Generated News Summaries
- Generalization Bias in Large Language Model Summarization of Scientific Research
- Behavioral Analysis of Information Salience in Large Language Models
- SCOPE: A Generative Approach for LLM Prompt Compression
- What's in the News? Towards Identification of Bias by Commission, Omission, and Source Selection (COSS)
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection