The Linear Representation Hypothesis Needs a Group Action
cs.LG, cs.AI, cs.CL
Submitted: 2026-09-22
Updated: 2026-09-22
Terminology
Sources
- Understanding intermediate layers using linear classifier probes
- Cross-Lingual Steering for Figurative Language Generation
- Curveball Steering: The Right Direction To Steer Isn't Always Linear
- How Many Features Can a Language Model Store Under the Linear Representation Hypothesis?
- Toy Models of Superposition
- Towards Unifying Interpretability and Control: Evaluation via Intervention
- Steering Language Models With Activation Engineering
- Multi-Head Attention as Ensemble Nadaraya-Watson Estimation: Variance Reduction, Decorrelation, and Optimal Head Diversity
- PRISM-$\Delta$: Differential Subspace Steering for Prompt Highlighting in Large Language Models
- Measuring Affinity between Attention-Head Weight Subspaces via the Projection Kernel
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks