FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos

arXiv:2609.00377 · cs.CV, cs.AI, cs.GR · Submitted 2026-08-31 · Read on arXiv

cs.CV, cs.AI, cs.GR

Submitted: 2026-08-31

Updated: 2026-08-31

Code: https://github.com/edemaine/fold

Project page: https://maya-moriya.github.io/origami-page

Terminology

• Trace — 18× in this paper · explained in 2 episodes
• Action Space — 12× in this paper · explained in 1 episode
• Verification — 11× in this paper · explained in 2 episodes
• Agentic Framework — 9× in this paper · explained in 6 episodes
• Ablation — 7× in this paper · explained in 1 episode
• Generalization — 4× in this paper · explained in 13 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Benchmarking — 2× in this paper · explained in 3 episodes
• Compilation Validity — 2× in this paper
• Conference on Computer Vision and Pattern Recognition — 2× in this paper
• Consistency — 2× in this paper · explained in 3 episodes
• Constraint Satisfaction — 2× in this paper
• Crease-Pattern Dissimilarity — 2× in this paper
• Final Folded State — 2× in this paper
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Geometric Similarity — 2× in this paper
• Proceedings of the National Academy of Sciences — 2× in this paper
• Topological Structure Similarity — 2× in this paper
• Verifier — 2× in this paper · explained in 2 episodes
• Agent Interactions — 1× in this paper · explained in 1 episode
• Alignment — 1× in this paper · explained in 1 episode
• Closed-Loop System — 1× in this paper · explained in 4 episodes
• Conference on Human Factors in Computing Systems — 1× in this paper
• Decode — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Flexible Origami List Datastructure — 1× in this paper
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 2 episodes
• International Conference on Document Analysis and Recognition — 1× in this paper
• International Symposium on Mixed and Augmented Reality — 1× in this paper
• Inverse Design — 1× in this paper · explained in 2 episodes
• Motion Primitives — 1× in this paper · explained in 2 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Nadia — 1× in this paper · explained in 2 episodes
• Reasoning Traces — 1× in this paper · explained in 3 episodes
• Semantic Gap — 1× in this paper · explained in 2 episodes

Sources

• Can AI Understand the Language of Origami?
• Vision-Language Models as Differentiable Semantic and Spatial Rewards for Text-to-3D Generation
• Sparks of Artificial General Intelligence: Early experiments with GPT-4
• Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models
• ChartLlama: A Multimodal LLM for Chart Understanding and Generation
• Learn2Fold: Structured Origami Generation with World Model Planning
• IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering
• LL3M: Large Language 3D Modelers
• Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects
• GamiBench: Evaluating Spatial Reasoning and 2D-to-3D Planning Capabilities of MLLMs with Origami Folding Tasks
• SketchAgent: Language-Driven Sequential Sketch Generation
• GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation
• ReAct: Synergizing Reasoning and Acting in Language Models
• Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models