Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation

arXiv:2610.01092 · cs.CV · Submitted 2026-10-01 · Read on arXiv

cs.CV

Submitted: 2026-10-01

Updated: 2026-10-01

Code: https://github.com/Comfy-Org/ComfyUI

Terminology

• Benchmark — 52× in this paper · explained in 2 episodes
• Alignment — 30× in this paper · explained in 1 episode
• Consistency — 18× in this paper · explained in 3 episodes
• Verification — 12× in this paper · explained in 2 episodes
• Ablation — 11× in this paper · explained in 1 episode
• World Model — 11× in this paper · explained in 7 episodes
• Accuracy — 8× in this paper · explained in 1 episode
• Aggregation — 7× in this paper · explained in 1 episode
• Calibration — 5× in this paper · explained in 7 episodes
• Fidelity — 4× in this paper · explained in 2 episodes
• Generative AI — 4× in this paper · explained in 2 episodes
• Adaptation — 3× in this paper · explained in 1 episode
• Affordance — 2× in this paper · explained in 1 episode
• Annotator Agreement — 2× in this paper · explained in 1 episode
• Benchmarking — 2× in this paper · explained in 3 episodes
• Failure Modes — 2× in this paper · explained in 3 episodes
• Generative Model — 2× in this paper · explained in 2 episodes
• Generative Models — 2× in this paper · explained in 2 episodes
• Temporal consistency — 2× in this paper · explained in 2 episodes
• Trace — 2× in this paper · explained in 2 episodes
• AI Alignment — 1× in this paper · explained in 2 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Aperture — 1× in this paper · explained in 1 episode
• Clustering — 1× in this paper · explained in 2 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Elias — 1× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Fourteenth International Conference on Learning Representations — 1× in this paper
• Generalization — 1× in this paper · explained in 13 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Physical Constraints — 1× in this paper · explained in 7 episodes
• Provenance — 1× in this paper · explained in 3 episodes
• Selection Bias — 1× in this paper · explained in 4 episodes
• Vision-Language Model (VLM) — 1× in this paper · explained in 3 episodes

Sources

• VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generation
• Rethinking Video Generation Model for the Embodied World
• Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Test
• DreamGen: Unlocking Generalization in Robot Learning through Video World Models
• RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
• HunyuanVideo: A Systematic Framework For Large Video Generative Models
• Cosmos 3: Omnimodal World Models for Physical AI
• World Reasoning Arena
• H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models
• EgoForge: Goal-Directed Egocentric World Simulator
• VQQA: An Agentic Approach for Video Evaluation and Quality Improvement
• Seedance 2.0: Advancing Video Generation for World Complexity
• Wan: Open and Advanced Large-Scale Video Generative Models
• The Trinity of Consistency as a Defining Principle for General World Models
• WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models