QUBRIC: Co-Designing Queries and Rubrics for RL Beyond Verifiable Rewards
cs.CL, cs.AI
Submitted: 2026-06-02
Updated: 2026-08-29
Terminology
Sources
- Limits of Generalization in RLVR: Two Case Studies in Mathematical Reasoning
- MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- AdvancedIF: Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following
- Reinforcement Learning with Rubric Anchors
- Open Rubric System: Scaling Reinforcement Learning with Pairwise Adaptive Rubric
- From Verifiable Dot to Reward Chain: Harnessing Verifiable Reference-based Rewards for Reinforcement Learning of Open-ended Generation
- Golden Goose: A Simple Trick to Synthesize Unlimited RLVR Tasks from Unverifiable Internet Text
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice
- Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Training
- Instruction-Following Evaluation for Large Language Models
- Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering