"When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspaces

arXiv:2603.02050 · cs.HC, cs.AI · Submitted 2026-03-02 · Read on arXiv

cs.HC, cs.AI

Submitted: 2026-03-02

Updated: 2026-09-20

Comments: Check the demo videos on the website: https://cleo.kixlab.org/

Project page: https://cleo.kixlab.org

License: http://creativecommons.org/licenses/by/4.0/

The gist: Shared co-creative workspaces allow users to contribute while agents execute.

Terminology

Abstract

Shared co-creative workspaces allow users to contribute while agents execute. Yet how users adjust their participation as their work and the agent's execution shape one another remains less understood. We conducted two design probe studies with professional designers. In Study 1 (N=10), participants identified opportunities to contribute by observing the agent's progress, but avoided intervention when the agent misinterpreted their edits. Therefore, we developed CLEO, a second probe that tracks user actions and selectively updates its plan. In Study 2 (N=12), we analyzed 255 interaction turns and stimulated recall interviews, identifying five action categories, ten codes, six triggers, and four enabling factors. Participants engaged in concurrent interaction during 33.73% of turns, expressing newly recognized design ideas or preferences through edits and changing the division of work by completing pending subtasks or independently developing copies of unfinished outputs. We present a decision model and five design implications for concurrent human-agent collaboration.

Sources

Related papers