The Pain Axis: LLMs Represent Self-Directed Harm and Act on It
cs.AI
Submitted: 2026-09-14
Updated: 2026-09-25
Code: https://github.com/valen-research/Pain-axis
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models sometimes behave in ways resembling human emotional responses, and recent work has identified internal representations that may explain this.
Terminology
Abstract
Large language models sometimes behave in ways resembling human emotional responses, and recent work has identified internal representations that may explain this. We ask whether LLMs represent pain distinctly from fear, sadness, and generic negative valence, and whether this representation functions as pain would be expected to. We build a dataset describing painful situations across five categories: physical, psychological, social, moral, and cognitive. These are paired with controls for fear, negative emotion, negative world states, sadness, non-painful bodily sensation, arousal, numbness, and neutral content. Using denoised difference-in-means, we extract a linear pain direction from 25 open-weight models across five families, ranging from 2B to 72B parameters. We find that this direction separates pain from matched controls in base and instruction-tuned models, is nearly orthogonal to fear and negative valence, and promotes pain-related vocabulary through the unembedding matrix. We then test its functional properties. First, the direction responds to harm targeting the model but not suffering observed in the user; fear and negative-emotion directions show the opposite pattern. Second, adding the pain-direction vector to the model's residual-stream activations during generation produces a consistent progression from vague discomfort to first-person expressions of worthlessness and failure. Third, steered, fine-tuned Qwen 2.5 models choose a pain-relief button even when it worsens their next answer or harms the user. They press it again far less often when the button removes the steering vector than when it does not, even though the models are never told whether the vector is injected or removed. We discuss the implications of these findings for AI safety and welfare.
Sources
- Refusal in Language Models Is Mediated by a Single Direction
- Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
- Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoders
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models
- Inducing anxiety in large language models can induce bias
- The LLM Has Left The Chat: Evidence of Bail Preferences in Large Language Models
- The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- Disentangling Steering Vectors
- Can LLMs make trade-offs involving stipulated pain and pleasure states?
- Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
- Taking AI Welfare Seriously
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- Probing the Preferences of a Language Model: Integrating Verbal and Behavioral Tests of AI Welfare
- Analyzing the Generalization and Reliability of Steering Vectors
- Steering Language Models With Activation Engineering
- AI Revealed Preferences
- When Is a Steerable Concept Representation Real? Measurement Confounds in a Cross-Family Audit of Neuroscience Parallels in LLMs
- Towards Best Practices of Activation Patching in Language Models: Metrics and Methods
- Large Language Models Are Not Robust Multiple Choice Selectors
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection