GUI-GenBench: Evaluating Image Generation Models as Interactive GUI Environments

arXiv:2602.09007 · cs.AI, cs.CV · Submitted 2026-02-09 · Read on arXiv

cs.AI, cs.CV

Submitted: 2026-02-09

Updated: 2026-09-26

Code: https://github.com/stepfun-ai/GEBench

Terminology

• Consistency — 37× in this paper · explained in 3 episodes
• Grounding — 34× in this paper · explained in 3 episodes
• Benchmark — 29× in this paper · explained in 2 episodes
• Fidelity — 22× in this paper · explained in 2 episodes
• Alignment — 12× in this paper · explained in 1 episode
• Hallucination — 10× in this paper · explained in 3 episodes
• Benchmarking — 9× in this paper · explained in 3 episodes
• Core — 8× in this paper · explained in 2 episodes
• Accuracy — 7× in this paper · explained in 1 episode
• Generative Model — 5× in this paper · explained in 2 episodes
• Generative Models — 5× in this paper · explained in 2 episodes
• Verification — 4× in this paper · explained in 2 episodes
• Graphical User Interface — 3× in this paper
• Structural Integrity — 3× in this paper · explained in 3 episodes
• Affordance — 2× in this paper · explained in 1 episode
• Calibration — 2× in this paper · explained in 7 episodes
• Diffusion Model — 2× in this paper · explained in 8 episodes
• Diffusion Models — 2× in this paper · explained in 6 episodes
• Reinforcement Learning — 2× in this paper · explained in 4 episodes
• Robustness — 2× in this paper · explained in 5 episodes
• Semantic Alignment — 2× in this paper · explained in 3 episodes
• Transformer — 2× in this paper · explained in 2 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Decoupling — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• International Conference on Software Engineering — 1× in this paper
• International Requirements Engineering Conference — 1× in this paper
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Nash Equilibrium — 1× in this paper · explained in 2 episodes
• Structural Control — 1× in this paper · explained in 2 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Vision Language Model — 1× in this paper
• World Model — 1× in this paper · explained in 7 episodes

Sources

• UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokens
• Qwen3-VL Technical Report
• Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
• Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
• Emerging Properties in Unified Multimodal Pretraining
• Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokens
• ControlGUI: Guiding Generative GUI Exploration through Perceptual Visual Flow
• Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark
• ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment
• GPT-4o System Card
• Zero-Shot Prompting Approaches for LLM-based Graphical User Interface Generation
• MobileWorldBench: Towards Semantic World Modeling For Mobile Agents
• Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedback
• Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videos
• Step1X-Edit: A Practical Framework for General Image Editing
• UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
• ViMo: A Generative Visual GUI World Model for App Agents
• WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Seedream 4.0: Toward Next-generation Multimodal Image Generation

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection