USA: Update-aware SAM for Cross-domain On-Policy Disitllation of Language Agents
cs.CL
Submitted: 2026-09-28
Updated: 2026-09-28
Terminology
Sources
- VOLD: Reasoning Transfer from LLMs to Vision-Language Models via On-Policy Distillation
- Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation
- SODA: Semi On-Policy Black-Box Distillation for Large Language Models
- Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs
- MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning
- ReTool: Reinforcement Learning for Strategic Tool Use in LLMs
- Sharpness-Aware Minimization for Efficiently Improving Generalization
- Skywork Open Reasoner 1 Technical Report
- Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision
- Reinforcement Learning via Self-Distillation
- Editing Models with Task Arithmetic
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- Unifying Group-Relative and Self-Distillation Policy Optimization via Sample Routing
- ToRL: Scaling Tool-Integrated RL
- Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
- Engineering Reasoning and Instruction (ERI) Benchmark: A Large Taxonomy-driven Dataset for Foundation Models and Agents
- Privileged Information Distillation for Language Models
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering