CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships

arXiv:2609.00250 · cs.CY, cs.AI, cs.CL, cs.LG · Submitted 2026-08-31 · Read on arXiv

cs.CY, cs.AI, cs.CL, cs.LG

Submitted: 2026-08-31

Updated: 2026-08-31

Code: https://github.com/jacyanthis/CompanionSim

Terminology

• Generative AI — 4× in this paper · explained in 2 episodes
• Accountability — 3× in this paper · explained in 2 episodes
• Benchmark — 3× in this paper · explained in 2 episodes
• Consistency — 2× in this paper · explained in 3 episodes
• Reinforcement Learning — 2× in this paper · explained in 4 episodes
• Sycophancy — 2× in this paper · explained in 4 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Adversarial Prompting — 1× in this paper · explained in 1 episode
• Alignment — 1× in this paper · explained in 1 episode
• Calibration — 1× in this paper · explained in 7 episodes
• Core — 1× in this paper · explained in 2 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Homogeneity — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Mode Collapse — 1× in this paper · explained in 2 episodes
• Synthetic Data Generation — 1× in this paper · explained in 5 episodes
• Synthetic Data Generation Pipeline — 1× in this paper · explained in 2 episodes

Sources

• How Tech Workers Contend with Hazards of Humanlikeness in Generative AI
• WILDCHAT-50M: A Deep Dive Into the Role of Synthetic Data in Post-Training
• How AI Companionship Develops: Evidence from a Longitudinal Study
• Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• Robots, Chatbots, Self-Driving Cars: Perceptions of Mind and Morality Across Artificial Intelligences
• Sycophancy in Large Language Models: Causes and Mitigations
• Digital Companionship: Overlapping Uses of AI Companions and AI Assistants
• The Dynamics of Delusion: Modeling Bidirectional False Belief Amplification in Human-Chatbot Dialogue
• Characterizing Delusional Spirals through Human-LLM Chat Logs
• LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
• The Case for "Thick Evaluations" of Cultural Representation in AI
• A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support
• Taxonomy of User Needs and Actions
• Sociotechnical Safety Evaluation of Generative AI Systems
• Can Large Language Model Agents Simulate Human Trust Behavior?
• WildChat: 1M ChatGPT Interaction Logs in the Wild
• LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Related papers

• Reasoning Enhances Robustness to Prompt Injection in LLM-Based Consensus
• Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot
• PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks
• What is an intelligent system?
• AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
• Generative AI Use in Entrepreneurship: An Integrative Review and an Empowerment-Entrapment Framework