DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction

arXiv:2609.39198 · cs.RO · Submitted 2026-09-30 · Read on arXiv

cs.RO

Submitted: 2026-09-30

Updated: 2026-09-30

Terminology

• Optical Flow — 22× in this paper · explained in 2 episodes
• Benchmark — 18× in this paper · explained in 2 episodes
• Ablation — 9× in this paper · explained in 1 episode
• Reinforcement Learning — 8× in this paper · explained in 4 episodes
• VLA Models — 8× in this paper · explained in 3 episodes
• Robustness — 6× in this paper · explained in 5 episodes
• Action Chunking — 5× in this paper · explained in 1 episode
• Generalization — 5× in this paper · explained in 13 episodes
• Fine-Tuning — 4× in this paper · explained in 5 episodes
• Flow Matching — 4× in this paper · explained in 7 episodes
• Generative AI — 3× in this paper · explained in 2 episodes
• Ablation study — 2× in this paper · explained in 1 episode
• Actor — 2× in this paper · explained in 3 episodes
• International Conference on Robotics and Automation — 2× in this paper
• Online Reinforcement Learning — 2× in this paper · explained in 2 episodes
• Real-Time Chunking — 2× in this paper
• Vision-Language-Action (VLA) Models — 2× in this paper · explained in 2 episodes
• Actor-Critic Architecture — 1× in this paper · explained in 1 episode
• Adaptation — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Distribution Shift — 1× in this paper · explained in 5 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Latent Space — 1× in this paper · explained in 7 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Point Clouds — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Self-Supervised Learning — 1× in this paper · explained in 7 episodes
• Semantic Understanding — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Two-stage training — 1× in this paper · explained in 2 episodes
• While Vision-Language-Action — 1× in this paper
• Zero-Shot Generalization — 1× in this paper · explained in 5 episodes

Sources

• $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
• Real-Time Execution of Action Chunking Flow Policies
• Training-Time Action Conditioning for Efficient Real-Time Chunking
• AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
• Towards Generalizable Robotic Manipulation in Dynamic Environments
• VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
• $\pi^{*}_{0.6}$: a VLA That Learns From Experience
• AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models
• DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
• OpenVLA: An Open-Source Vision-Language-Action Model
• CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
• RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation
• Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling
• VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning
• Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Tasks
• Reinforcement Learning for Flow-Matching Policies
• Leave No Observation Behind: Real-time Correction for VLA Action Chunks
• SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
• VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference
• Octo: An Open-Source Generalist Robot Policy

Related papers

• FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
• MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
• RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
• HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
• APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies
• Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving