OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human Demonstrations
cs.HC, cs.AI
Submitted: 2026-09-02
Updated: 2026-09-10
Comments: Accpeted by EMNLP 2026 demo track
DOI: 10.21203/rs.3.rs-10741604/v1
Code: https://github.com/baidu-frontier-research/omegause-sop
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning
- OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents
- Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents
- UFO2: The Desktop AgentOS
- OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution
- PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks
- Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields
- OmniParser for Pure Vision Based GUI Agent
- SOP-Bench: Complex Industrial SOPs for Evaluating LLM Agents
Related papers
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Linking Behaviour and Perception to Evaluate Meaningful Human Control over Partially Automated Driving
- Review of Explainable Decision Support and Adaptive Human-Machine Interfaces for Automation Transparency in Maritime Autonomous Surface Ships
- Towards Cognitive Process-Aware Proactive Writing Support