Vibe Patenting: Evaluating LLM Judges for Professional Patent-Drafting Agents
cs.AI, cs.LG, cs.MA
Submitted: 2026-09-11
Updated: 2026-09-24
Comments: 29 pages, 18 figures
Project page: https://gair-nlp.github.io/auto-j
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- JudgeBench: A Benchmark for Evaluating LLM-based Judges
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
- Self-Preference Bias in LLM-as-a-Judge
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- ReAct: Synergizing Reasoning and Acting in Language Models
- Evaluating Large Language Models at Evaluating Instruction Following
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection