The Analyst in the Prompt: Role, Retrieval, and Memory Biases in LLM Financial Analysis

arXiv:2609.03218 · cs.CL, cs.CE, q-fin.PM · Submitted 2026-09-02 · Read on arXiv

cs.CL, cs.CE, q-fin.PM

Submitted: 2026-09-02

Updated: 2026-09-02

Terminology

• Neutral Retrieval — 10× in this paper
• Personalization — 10× in this paper · explained in 2 episodes
• Benchmark — 5× in this paper · explained in 2 episodes
• Clustering — 5× in this paper · explained in 2 episodes
• Cosine Similarity — 4× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 3× in this paper · explained in 6 episodes
• Persona Retrieval — 3× in this paper
• Ablation — 2× in this paper · explained in 1 episode
• Adaptation — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper · explained in 1 episode
• Benchmarking — 2× in this paper · explained in 3 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Persona Prompting — 2× in this paper · explained in 2 episodes
• Accountability — 1× in this paper · explained in 2 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Distribution Shift — 1× in this paper · explained in 5 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Perplexity — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Scaffolding — 1× in this paper · explained in 3 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• FinBERT: Financial Sentiment Analysis with Pre-trained Language Models
• Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection
• Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models
• Financial Statement Analysis with Large Language Models
• Persona is a Double-edged Sword: Mitigating the Negative Impact of Role-playing Prompts in Zero-shot Reasoning Tasks
• The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models
• Evaluating LLMs in Finance Requires Explicit Bias Consideration
• Your AI, Not Your View: The Bias of LLMs in Investment Analysis
• Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting
• BloombergGPT: A Large Language Model for Finance
• PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance
• FinGPT: Open-Source Financial Large Language Models
• PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering