Robotics papers — 2026-10-18
The Morning Preprint — this day as one edition: the day's papers, the five things worth knowing, and the episodes behind them.
This is a look at making robot vision language action models more connected to real physical space, which is important because these models often use 2D image coordinates instead of actual camera geometry. This problem becomes a big issue when systems use several cameras where the relationship between the views is known but not used in the visual processing.
The most important work involves G cubed VLA, which adds a camera-aware geometric module to inject calibrated structure into the visual-token stream of pretrained VLA models without changing their original action space or learning objective. This is done by combining intrinsic-conditioned ray embeddings, projective positional encoding, and bidirectional cross-view fusion to create geometrically consistent representations across different camera views.
This geometric grounding is useful because it allows training using ground truth point maps or confidence-gated teacher predictions, which has shown improvements on tasks like RoboTwin2.0 when using three cameras with ground truth supervision. This consistency is also tested in camera-shifted scenarios, where the gains depend on correct camera geometry but remain stable under mild calibration changes.
Another important direction focuses on structuring latent actions to better capture how much change a robot makes and what kind of change it makes, which is addressed by PoLAR. PoLAR imposes a radial structure on latent actions, using temporal offsets as a proxy for transition extent to encourage larger radii for larger changes in the action space. This approach has been shown to improve downstream policy performance in both simulation and real-world robot experiments compared to existing latent action baselines.
For navigation in uncertain environments, Schrödinger's Navigator proposes a belief-aware framework that reasons over multiple imagined 3D futures at inference time, maintaining a superposition of plausible scene realizations instead of committing to one map. This method uses an adaptive occluder-aware sampler to focus imagination on uncertain regions and aggregates these futures into a Future-Aware Value Map for safer action selection.
Finally, there is work tackling planning under uncertainty in Partially Observable Markov Decision Processes using VOiLA, which learns task-agnostic world models through diffusion models to enable efficient online planning. This framework has shown that the distillation strategy can reduce sampling costs by nearly three orders of magnitude while achieving performance equal to or better than current reinforcement learning methods for POMDPs.
The most important takeaway is that allocating test-time compute intelligently, rather than scaling it uniformly, is key to achieving high performance for embodied agents where deployment matters most. This idea is central to DIRECT, which introduces a routing framework that uses multimodal scene context to allocate compute at each step of a closed-loop agent by selecting a planner for every subtask.
This routing approach shows that test-time compute is not a simple lever; different scaling axes, like chain-of-thought depth or model size, lead to qualitatively different gains. For instance, experiments on VLABench and RoboMME demonstrated that this selective allocation can match or exceed the success rate of a stronger model while using up to sixty five percent less average latency on a physical Franka arm in a DROID setup.
Furthermore, this idea connects to how policies handle memory, as RMBench systematically evaluates manipulation tasks spanning multiple levels of memory complexity, highlighting where existing policies struggle with reasoning over historical observations. This systematic evaluation helps inform the design of modular policies like Mem-0, which explicitly include memory components for controlled study.
Today's papers
- G cubed VLA: Geometric Inductive Bias for Vision-Language-Action Models A camera-aware geometric module injects calibrated structure into visual tokens to improve consistency across different camera views. [paper] [episode]
- PoLAR: Factorizing Extent and Mode in Latent Actions for Robot Policy Learning This method structures latent actions by extent and mode to better map them to robot actions. [paper] [episode]
- Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation This framework reasons over multiple imagined 3D futures to enable robust zero-shot navigation in uncertain real-world environments. [paper] [episode]
- VOiLA: Vectorized Online Planning with Learned Diffusion Models for POMDP Agents This framework learns task-agnostic POMDP world models using diffusion models to enable efficient online planning under uncertainty. [paper] [episode]
- Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobility This neuro-symbolic framework augments motion prediction with interpretable logic to handle traffic regulations and behavioral constraints. [paper] [episode]
- Active Learning of Fractional-Order Viscoelastic Model Parameters for Realistic Haptic Rendering This study uses active learning to optimize parameters of fractional-order models for realistic haptic rendering of viscoelastic materials. [paper] [episode]
- TADPO: Reinforcement Learning Goes Off-road A novel policy gradient formulation extends PPO to enable reinforcement learning policies on full-scale off-road vehicles. [paper] [episode]
- Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving This method uses a dual-decoupling design to personalize autonomous driving by separating intent understanding from trajectory planning. [paper] [episode]
- DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners? This routing framework allocates test-time compute dynamically based on scene context to improve the success of embodied planners. [paper] [episode]
- RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design This benchmark systematically evaluates memory capabilities in robotic manipulation policies across different levels of complexity. [paper] [episode]
The papers
- G cubed VLA: Geometric Inductive Bias for Vision-Language-Action Models — The gist The G3VLA framework introduces a camera-aware geometric module that injects calibrated structure into the visual-token stream of pretrained Vision-Language-Action (VLA) policies without altering its action space or imitation objective, yielding consistent gains across se [episode]
- Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation — The gist: Schrodinger’s Navigator addresses zero-shot object navigation limitations by modeling unobserved regions as plausible futures and reasoning over them at inference time to improve robustness in occlusion-heavy scenarios. [episode]
- PoLAR: Factorizing Extent and Mode in Latent Actions for Robot Policy Learning — The gist Latent action pretraining learns representations of visual change from pairs of observations, but existing methods typically encode each transition as a single unstructured representation that entangles transition extent and transition mode; PoLAR introduces Polar Latent [episode]
- VOiLA: Vectorized Online Planning with Learned Diffusion Models for POMDP Agents — The gist: VOiLA, a framework for approximate POMDP solving without a priori models, combines diffusion-based generative modeling with model distillation to learn task-agnostic transition and observation samplers and observation-likelihood models that support both particle-based b [episode]
- Active Learning of Fractional-Order Viscoelastic Model Parameters for Realistic Haptic Rendering — The gist: Generalized fractional-order viscoelastic models established through the proposed HiL optimization and aggregation approach possess the potential to significantly improve the simto-real transition performance of medical training simulators. [episode]
- Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobility — The gist The proposed Trajectory Compliance-Shaping (TraCS) framework is a neuro-symbolic system that augments existing motion prediction backbones with interpretable and probabilistic first-order logic to align predictions with real-world traffic regulations, showing consistent [episode]
- TADPO: Reinforcement Learning Goes Off-road — The gist The authors introduce TADPO, a novel policy gradient formulation that extends Proximal Policy Optimization (PPO), to enable concurrent learning from fixed demonstrations and on-policy interactions to tackle long-horizon planning and hard exploration problems in off-road [episode]
- Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving — The gist The proposed M-Diffusion Planner is an RL-guided multi-strategy framework with a diffusion-based multi-head planner integrated with LLM-based semantic understanding, enabling dynamic perception of user intent and generation of diverse, preference-aligned trajectories. [episode]
- DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners? — Detailed Research Summary of DIRECT: Dynamic Compute Allocation for Vision-Language Models in Embodied Planning As a diligent researcher, I have thoroughly analyzed the provided excerpts from the paper describing DIRECT (Dynamic Routing for Efficient Computation). [episode]
- RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design — The gist: This paper introduces RMBench, a new simulation benchmark for memory-dependent robotic manipulation, and Mem-0, a modular memory-oriented policy designed to systematically evaluate and improve policy design concerning long-term memory. [episode]
Important terms
- G cubed VLA
- This work adds a camera-aware geometric module to vision language action models. It injects calibrated structure into visual tokens using ray embeddings and cross-view fusion, making the model aware of real physical space.
- PoLAR
- This technique structures latent actions radially. It uses temporal offsets to represent how much change a robot makes, encouraging larger changes for larger action radii in simulation and real tests.
- Schrödinger's Navigator
- This framework plans in uncertain environments by reasoning over multiple imagined 3D futures at inference time. It maintains a mix of possible scenes instead of committing to just one map.
- DIRECT routing framework
- This introduces a way to intelligently allocate test-time compute. It uses scene context to select the best planner for each small task, showing that selective allocation is more effective than uniform scaling.