How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human-AI Conflict Response

arXiv:2411.07042 · cs.HC, cs.AI, cs.CL, cs.CY · Submitted 2024-11-11 · Read on arXiv

cs.HC, cs.AI, cs.CL, cs.CY

Submitted: 2024-11-11

Updated: 2026-09-24

Terminology

• Core — 7× in this paper · explained in 2 episodes
• Frustration — 6× in this paper · explained in 2 episodes
• Accountability — 5× in this paper · explained in 2 episodes
• Alignment — 5× in this paper · explained in 1 episode
• Actor — 2× in this paper · explained in 3 episodes
• Grounding — 2× in this paper · explained in 3 episodes
• Institutional Review Board — 2× in this paper
• Interpretability — 2× in this paper · explained in 15 episodes
• Personalization — 2× in this paper · explained in 2 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Adaptation — 1× in this paper · explained in 1 episode
• Affordance — 1× in this paper · explained in 1 episode
• Cooperation — 1× in this paper · explained in 2 episodes
• EMMA — 1× in this paper · explained in 2 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Steering — 1× in this paper · explained in 2 episodes

Sources

• From Persona to Personalization: A Survey on Role-Playing Language Agents
• User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions
• The Ghost in the Machine has an American accent: value conflict in GPT-3
• Harmful Traits of AI Companions
• "My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Community
• Alert of the Second Decision-maker: An Introduction to Human-AI Conflict
• Principles of Safe AI Companions for Youth: Parent and Expert Perspectives

Related papers

• EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
• EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
• HAGI++: Head-Assisted Gaze Imputation and Generation
• Linking Behaviour and Perception to Evaluate Meaningful Human Control over Partially Automated Driving
• Review of Explainable Decision Support and Adaptive Human-Machine Interfaces for Automation Transparency in Maritime Autonomous Surface Ships
• Towards Cognitive Process-Aware Proactive Writing Support