Diff Mining: Logit Differences Reveal Finetuning Objectives
cs.LG, cs.AI, cs.CL
Submitted: 2026-08-26
Updated: 2026-08-26
Code: https://github.com/safety-research/petri
Terminology
Sources
- Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMs
- MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
- On Domain-Adaptive Post-Training for Multimodal Large Language Models
- Training Verifiers to Solve Math Word Problems
- Towards eliciting latent knowledge from LLMs with mechanistic interpretability
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Alignment faking in large language models
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
- Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI
- Auditing language models for hidden objectives
- Frontier Models are Capable of In-context Scheming
- Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning
- OpenAI o1 System Card
- Towards Understanding Sycophancy in Language Models
- Believe It or Not: How Deeply do LLMs Believe Implanted Facts?
- Auditing Games for Sandbagging
- Persona Features Control Emergent Misalignment
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks