WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon

arXiv:2609.35560 · cs.CV · Submitted 2026-09-28 · Read on arXiv

cs.CV

Submitted: 2026-09-28

Updated: 2026-09-28

Code: https://github.com/madebyollin/taehv

Project page: https://worldplay2.github.io

Terminology

• Distillation — 60× in this paper · explained in 2 episodes
• Consistency — 52× in this paper · explained in 3 episodes
• World Model — 46× in this paper · explained in 7 episodes
• Ablation — 10× in this paper · explained in 1 episode
• Fidelity — 7× in this paper · explained in 2 episodes
• Quantization — 7× in this paper · explained in 12 episodes
• Distribution Matching — 6× in this paper · explained in 2 episodes
• Embeddings — 6× in this paper · explained in 2 episodes
• Accuracy — 5× in this paper · explained in 1 episode
• Benchmark — 5× in this paper · explained in 2 episodes
• Diffusion Model — 5× in this paper · explained in 8 episodes
• Computational overhead — 4× in this paper · explained in 2 episodes
• Generalization — 4× in this paper · explained in 13 episodes
• Diffusion Models — 3× in this paper · explained in 6 episodes
• Transformer — 3× in this paper · explained in 2 episodes
• Core — 2× in this paper · explained in 2 episodes
• Exposure Bias — 2× in this paper · explained in 2 episodes
• Flow Matching — 2× in this paper · explained in 8 episodes
• Generative Modeling — 2× in this paper · explained in 3 episodes
• Mode Collapse — 2× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Ablation study — 1× in this paper · explained in 1 episode
• Abstraction — 1× in this paper · explained in 1 episode
• Alignment — 1× in this paper · explained in 1 episode
• Commentary — 1× in this paper · explained in 2 episodes
• Communication Overhead — 1× in this paper · explained in 2 episodes
• Entanglement — 1× in this paper · explained in 4 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Fully Sharded Data Parallel — 1× in this paper
• Generalizability — 1× in this paper · explained in 6 episodes
• Information Leakage — 1× in this paper · explained in 2 episodes
• Memory Decay — 1× in this paper · explained in 3 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Semantic Drift — 1× in this paper · explained in 3 episodes
• Sparse Attention — 1× in this paper · explained in 5 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Unreal Engine — 1× in this paper
• Vision-Language Model (VLM) — 1× in this paper · explained in 3 episodes

Sources

• Cosmos 3: Omnimodal World Models for Physical AI
• Qwen3-VL Technical Report
• Flex Attention: A Programming Model for Generating Optimized Attention Kernels
• Infinite Worlds with Versatile Interactions
• AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillation
• Matrix-game 2.0: An open-source, real-time, and streaming interactive world model
• RELIC: Interactive Video World Model with Long-Horizon Memory
• ViPE: Video Pose Engine for 3D Geometric Perception
• ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU
• Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Condition
• Yume: An Interactive World Generation Model
• Parallel Decoding Distillation for Fast Image and Video Generation
• Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
• AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
• DreamX-World 1.0: A General-Purpose Interactive World Model
• Gemini: A Family of Highly Capable Multimodal Models
• Evaluating Gemini Robotics Policies in a Veo World Simulator
• INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
• Advancing Open-source World Models
• HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models