Opening LLM Judges: Recovering Preference Signals Beyond the Final Verdict
cs.AI
Submitted: 2026-09-26
Updated: 2026-09-26
Terminology
Sources
- Eliciting Latent Predictions from Transformers with the Tuned Lens
- Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators
- Judge Circuits Explain Format-Induced Inconsistency in LLM-as-a-Judge
- Reference-Free Rating of LLM Responses via Latent Information
- Localizing Model Behavior with Path Patching
- Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representations
- Actions Speak Louder than Words: Measuring Cross-Lingual Policy Retention in Tool-Using Agents
- The Geometry of LLM-as-Judge: Why Inter-LLM Consensus Is Not Human Alignment
- Verbosity Bias in Preference Labeling by Large Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection