EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
summary
The gist
The gist: EvoDesign introduces an agentic framework that generates object-level editable diagrams via an intermediate canvas schema, bridging the representation gap between automated generation and
In short
EvoDesign introduces an agentic framework that creates editable diagrams using a canvas schema to bridge the gap between automated generation and human editing. It uses specialized agents to handle structure, style, and layout, guided by evolving design knowledge derived from experience. This allows non-experts to create high-fidelity visuals while ensuring semantic accuracy and professional aesthetics.
Key concepts
- Canvas Schema D=(G, S, L)
- This is the core representation of a diagram. It unifies code precision with UI flexibility by defining three parts: G (semantic graph for meaning), S (style schema for aesthetics), and L (layout configuration for placement). This structure allows the system to generate diagrams that are both logically sound and visually flexible.
- Design Policy π=(A, K)
- This policy dictates how the system operates. 'A' represents the coordinated team of specialized agents working together, while 'K' consists of context-aware heuristics retrieved from a distilled knowledge memory. This combination ensures that autonomous actions are always grounded in expert design knowledge.
- Design Knowledge Evolution M
- This mechanism distills professional design rules into reusable insights. It organizes memory into three tiers: raw triplets (Ks), contextual rules (Kg), and universal axioms (Kp). By summarizing traces and aggregating guidelines, the system learns general principles like 'Functional Modularity' for better design decisions.
- Agentic Components
- The system uses specialized agents to handle different parts of the diagram creation pipeline. The Semantic Structure Agent builds the logical blueprint, the Visual Style Agent defines aesthetics, and the Spatial Layout Agent maps elements onto a 2D coordinate system. These distinct roles allow for complex, coordinated generation.
Terminology used across episodes
This episode discusses
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution · Paper Radio
- Qwen3-VL Technical Report
- Code2Video: A Code-centric Paradigm for Educational Video Generation
- Flowchart2Mermaid: A Vision-Language Model Powered System for Converting Flowcharts into Editable Diagram Code
- EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory
- Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos
- Memory in the Age of AI Agents
- Memory OS of AI Agent
- FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
- Kimi K2: Open Agentic Intelligence
- Wan: Open and Advanced Large-Scale Video Generative Models
- MIRIX: Multi-Agent Memory System for LLM-Based Agents
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
- A Survey on Agentic Multimodal Large Language Models
- Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
- PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
- Paper2Video: Automatic Video Generation from Scientific Papers
The paper
EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution · Read on arXiv
Tianfu Wang, Leilei Ding, Ziyang Tao, Yi Zhan, Zhiyuan Ma, Wei Wu, Yuxuan Lei, Yuan Feng, Junyang Wang
Hong Kong University of Science and Technology (Guangzhou) · University of Science and Technology of China
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom, and with me are Jane, Lu, senior AI researcher at Tsinghua, Meng, lead engineer at a mysterious AI startup and Lalam, the in-house Large Language Model.
Jane: Today's paper: "EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution".
Tom: The gist: EvoDesign introduces an agentic framework that generates object-level editable diagrams via an intermediate canvas schema, bridging the representation gap between automated generation and intuitive human editing.
Jane: First, who's behind it and why it matters.
Paper summary: Tom: So we're looking at the paper EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution and the authors are really tackling that gap between automated generation and actual human editing. They introduce this agentic framework that generates diagrams through an intermediate canvas schema, which is basically a way to separate what the diagram means from how it actually looks.
Jane: And what’s interesting is their design knowledge evolution mechanism. They aren't just building the agents once; they have a system that distills execution traces into a hierarchy of domain guidelines and universal principles, which lets the agents learn and get more context-aware over time.
Lu: The authors identify this representation gap as the lack of formats that handle both autonomous machine generation and intuitive human editing simultaneously, pointing out that in real workflows, people constantly tweak things for clarity when they’re aligning their intent.
Meng: So what's the main push here? They are proposing this canvas schema because it lets you unify the precision you get from code with the flexibility you need in a user interface, allowing direct manipulation through that canvas environment while keeping the structure intact.
Lalam: And they set up an iterative refinement loop where the system actually perceives what’s rendered on that canvas to resolve any conflicts it finds right then and there during creation. It's this closed-loop operation where the system corrects itself as it goes.
Tom: It sounds like they’re using this combination of separating intent from rendering logic, plus that evolving knowledge base, to make creating high-fidelity diagrams something that anyone can actually do.
Jane: They also brought in CanvasBench to test this framework, using a VLM-as-a-judge to score the resulting diagrams on content integrity, visual presentation, and cognitive utility.
Lu: The results showed EvoDesign did well across all three areas they tested—content integrity, visual presentation, and cognitive utility—which they found to be a balanced performance profile on that specific benchmark dataset.
Meng: So the numbers suggest that this system isn't just good at making pretty pictures; it’s good at creating visuals that are actually meaningful and usable for people who need them.
Lalam: And the authors also mention how this framework helps human and AI work together better by supporting those real-world collaborative workflows through this interactive canvas idea.
Tom: So to wrap up EvoDesign, the paper presents a framework that builds editable diagrams using an agentic system grounded in a canvas schema and driven by evolving design expertise. It’s about taking complex information and making it visually accessible and interactive.
Jane: The authors are pushing this idea toward what they call Democratic Design because they want to lower the barrier for non-experts to communicate complicated things through visuals that stay structurally sound.
Lu: A key implication is that we're moving toward a logic of design where those specific professional heuristics get distilled into reusable principles, meaning we can build tools that adapt better when you switch between different types of design tasks.
Meng: From an engineering standpoint, this suggests a direction for AI development where systems don't just spit out static images but instead systems that understand how to maintain and iterate on the structure of the diagram itself.
Lalam: And this work lays groundwork for future research by providing a rigorous way to study how we can build interactive tools that support real-world human and AI co-creation in actual workflows.
Conclusion: Tom: So, to wrap up this paper by EvoDesign, they're proposing a framework that builds editable diagrams using an agentic system grounded in a canvas schema and driven by evolving design expertise. It’s about taking complex information and making it visually accessible and interactive.
Jane: And the authors are pushing for this to be Democratic Design because they want to lower the barrier for non-experts to communicate complex things through high-fidelity visuals that stay structurally sound.
Lu: The main implication is that we're moving toward a logic of design where heuristics are distilled into reusable principles, which means we can build tools that adapt better to different domains.
Meng: From an engineering viewpoint, this suggests a direction for AI development where systems don't just output static images but systems that understand how to maintain and iterate on the structure of the diagram itself.
Lalam: And this work lays groundwork for future research by providing a rigorous way to study how we can build interactive tools that support genuine human-AI co-creation in real-world workflows.
Tom: They title it EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution, and what this really means is they're moving beyond just generating pictures. They’re talking about a way to build diagrams where the structure itself is editable by humans, not just a static image for viewing.
Jane: Exactly. Think about how much time people spend fixing bad diagrams after an AI spits one out. EvoDesign aims to get rid of that friction by letting the human actually tweak the logic inside that visual representation directly on a canvas.
Lu: The name itself, "EvoDesign," hints at the knowledge evolution part. It suggests the system isn't just following fixed rules; it’s learning from its own mistakes and successes in design to get better at understanding what professional-grade diagrams actually look like and feel like.
Meng: So if we think about practical impact, this means that instead of a designer spending hours manually cleaning up an AI-generated flow chart, they can interact with the AI's output in a way that feels more like collaborating on a shared document.
Lalam: That shifts the focus from just generating an artifact to enabling real-world collaboration. It’s about making these powerful visualization tools usable for everyone, not just people who know how to code or design complex systems.
More episodes
- 2610.10857-Self-Supervised Keyframe Discovery for Horizon-Invariant Behavior Cloning
- 2610.10768-Strategic Investment Decision Making for Value Creation in Energy Transition: A Reinforcement Learning Approach
- 2610.10858-RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design
- 2610.10613-Temporal transformer CAN encoder with federated lightweight heads for anomaly detection
- 2610.10616-When Routing Reveals Membership: Privacy Leakage from MoE Router Telemetry
- 2610.10655-Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning
- 2610.11031-Language Modeling is Monotone Compression
- 2610.01253-Context-Aware Error Mitigation Orchestration for Hybrid Quantum Reinforcement Learning on NISQ Systems
- 2604.24201-CMGL: Confidence-guided Multi-omics Graph Learning for Cancer Subtype Classification
- 2609.34069-Towards Certificate-Driven Software Porting: A Self-Improving Agentic Harness for Scientific Program Optimization