Skill-Space Shooting for Autonomous Robot Policy Improvement

arXiv:2609.38178 · cs.RO, cs.AI, cs.LG · Submitted 2026-09-29 · Read on arXiv

cs.RO, cs.AI, cs.LG

Submitted: 2026-09-29

Updated: 2026-09-29

Terminology

• Foundation Model — 15× in this paper · explained in 3 episodes
• Conference on Robot Learning — 8× in this paper
• Foundation Models — 7× in this paper · explained in 7 episodes
• Accuracy — 6× in this paper · explained in 1 episode
• Reinforcement Learning — 6× in this paper · explained in 4 episodes
• Adaptation — 2× in this paper · explained in 1 episode
• Affordance — 2× in this paper · explained in 1 episode
• Agentic System — 2× in this paper · explained in 2 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Human-in-the-Loop — 2× in this paper · explained in 3 episodes
• In International Conference on Learning Representations — 2× in this paper
• International Conference on Robotics and Automation — 2× in this paper
• World Model — 2× in this paper · explained in 7 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Agentic Framework — 1× in this paper · explained in 6 episodes
• Aggregation — 1× in this paper · explained in 1 episode
• Calibration — 1× in this paper · explained in 7 episodes
• Conference on Computer Vision and Pattern Recognition — 1× in this paper
• Generative Modeling — 1× in this paper · explained in 3 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Motion Primitives — 1× in this paper · explained in 2 episodes
• Regret — 1× in this paper · explained in 3 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Temporal Abstraction — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• UniIntervene: Agentic Intervention for Efficient Real-World Reinforcement Learning
• To Err is Robotic: Rapid Value-Based Trial-and-Error during Deployment
• Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
• Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Intervention
• ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies
• RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correction
• Recover, Discover, Plan: Learning Skills and Concepts from Robot Failures
• RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks
• FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models
• ASPIRE: Agentic /Skills Discovery for Robotics
• Human-in-the-Loop Imitation Learning using Remote Teleoperation
• $\pi^{*}_{0.6}$: a VLA That Learns From Experience
• ValueFormer: A Causal Transformer Value Function with Stage-Aware Labels for Semi-Autonomous Vision-Language-Action Policies
• Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
• ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models

Related papers

• FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
• MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
• RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
• HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
• APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies
• Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving