HugAgent: A Human Simulation Benchmark for Individual-Level Reasoning

arXiv:2510.15144 · cs.AI, cs.CL, cs.CY · Submitted 2025-10-16 · Read on arXiv

cs.AI, cs.CL, cs.CY

Submitted: 2025-10-16

Updated: 2026-08-31

Terminology

• Accuracy — 74× in this paper · explained in 1 episode
• Benchmark — 69× in this paper · explained in 2 episodes
• Belief Dynamics Update — 57× in this paper
• Belief State Inference — 42× in this paper
• RAG — 17× in this paper · explained in 3 episodes
• Alignment — 16× in this paper · explained in 1 episode
• Fidelity — 16× in this paper · explained in 2 episodes
• Trace — 15× in this paper · explained in 2 episodes
• Adaptation — 14× in this paper · explained in 1 episode
• Consistency — 14× in this paper · explained in 3 episodes
• Generalization — 8× in this paper · explained in 13 episodes
• Core — 7× in this paper · explained in 2 episodes
• Mean Absolute Error — 7× in this paper
• Causal Belief Network — 6× in this paper
• Reasoning Traces — 6× in this paper · explained in 3 episodes
• Ablation — 5× in this paper · explained in 1 episode
• Benchmarking — 5× in this paper · explained in 3 episodes
• Adam — 4× in this paper · explained in 2 episodes
• Digital Twin — 4× in this paper · explained in 4 episodes
• Grounding — 4× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 4× in this paper · explained in 6 episodes
• Information Gain — 3× in this paper · explained in 2 episodes
• Interpretability — 3× in this paper · explained in 15 episodes
• Scaffolding — 3× in this paper · explained in 3 episodes
• Structured Reasoning — 3× in this paper · explained in 3 episodes
• Aggregation — 2× in this paper · explained in 1 episode
• Causal Reasoning — 2× in this paper · explained in 2 episodes
• Error Decomposition — 2× in this paper · explained in 3 episodes
• Failure Modes — 2× in this paper · explained in 3 episodes
• Human-in-the-Loop — 2× in this paper · explained in 3 episodes
• Personalization — 2× in this paper · explained in 2 episodes
• Probabilistic Language of Thought — 2× in this paper
• Provenance — 2× in this paper · explained in 3 episodes
• Regularization — 2× in this paper · explained in 3 episodes
• Verification — 2× in this paper · explained in 2 episodes
• World Model — 2× in this paper · explained in 7 episodes
• Adaptability — 1× in this paper · explained in 1 episode
• Alignment Scores — 1× in this paper · explained in 1 episode
• Bayesian Inference — 1× in this paper · explained in 5 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Commentary — 1× in this paper · explained in 2 episodes
• Domain Shift — 1× in this paper · explained in 4 episodes
• Downstream Tasks — 1× in this paper · explained in 2 episodes
• Dynamic Modeling — 1× in this paper · explained in 3 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Graph Construction — 1× in this paper · explained in 3 episodes
• In-Context Learning — 1× in this paper · explained in 4 episodes
• International Conference on Learning Representations — 1× in this paper
• Redundancy — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Semantic Alignment — 1× in this paper · explained in 3 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Standardized Metrics — 1× in this paper · explained in 3 episodes
• Theory of Mind (ToM) — 1× in this paper · explained in 2 episodes
• Transferability — 1× in this paper · explained in 4 episodes
• Work on Theory of Mind — 1× in this paper

Sources

• Relational inductive biases, deep learning, and graph networks
• ToMBench: Benchmarking Theory of Mind in Large Language Models
• Towards Measuring the Representation of Subjective Global Opinions in Language Models
• DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning
• Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies
• Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making
• HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models
• WikiWhy: Answering and Explaining Cause-and-Effect Questions
• Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning
• CommunityLM: Probing Partisan Worldviews from Language Models
• MMToM-QA: Multimodal Theory of Mind Question Answering
• Lyfe Agents: Generative agents for low-cost real-time social interactions
• FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions
• Simulating Society Requires Simulating Thought
• LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
• Machine Theory of Mind
• ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning
• A Roadmap to Pluralistic Alignment
• Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
• Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questions

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection