"What Are You Really Trying to Do?": Co-Creating Life Goals from Everyday Computer Use
cs.HC, cs.AI, cs.CL
Submitted: 2026-05-01
Updated: 2026-09-09
Comments: 20 pages, 8 figures, 1 table; Accepted at UIST 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent advances in user modeling make it feasible to conduct open-ended inference over a person's everyday computer use.
Terminology
Abstract
Recent advances in user modeling make it feasible to conduct open-ended inference over a person's everyday computer use. Despite longstanding visions of systems that deeply understand our actions and the purposes they serve in our lives, existing systems only capture what a person is doing in the moment, not why they are doing it, limiting these systems to surface-level support. We introduce striving co-creation, a process for inferring broader life goals from unstructured observations of computer use. Grounded in Activity Theory and Emmons' personal strivings framework, our system progressively constructs a hierarchical representation of a person's activities. Strivings are, however, difficult to fully resolve from observation alone, as the same action can be driven by many different goals. Our system therefore supports an editing interface that gives people agency over how they are understood by the system, feeding their corrections back into subsequent rounds of striving induction. In a week-long field deployment (N=14), we find that our co-creation process produces strivings that participants recognize as representative of their long-term goals and gives them greater agency than baseline methods.
Sources
- ELEPHANT: Measuring and understanding social sycophancy in LLMs
- State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital Living
- Cocoa: Co-Planning and Co-Execution with AI Agents
- The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users
- Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions
- Bloom: Designing for LLM-Augmented Behavior Change Interactions
- Just-In-Time Objectives: A General Approach for Specialized AI Interactions
- Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance
- Interactive Reasoning: Visualizing and Controlling Chain-of-Thought Reasoning in Large Language Models
- Who's in Charge? Disempowerment Patterns in Real-World LLM Usage
- Gemini: A Family of Highly Capable Multimodal Models
- An Explanation of In-context Learning as Implicit Bayesian Inference
- AI and My Values: User Perceptions of LLMs' Ability to Extract, Embody, and Explain Human Values from Casual Conversations
Related papers
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Linking Behaviour and Perception to Evaluate Meaningful Human Control over Partially Automated Driving
- Review of Explainable Decision Support and Adaptive Human-Machine Interfaces for Automation Transparency in Maritime Autonomous Surface Ships
- Towards Cognitive Process-Aware Proactive Writing Support