PUBG Ally: A Conversational Embodied Agent as an AI Teammate

arXiv:2609.29837 · cs.AI, cs.CL, cs.HC · Submitted 2026-09-24 · Read on arXiv

cs.AI, cs.CL, cs.HC

Submitted: 2026-09-24

Updated: 2026-09-25

Code: https://github.com/FunAudioLLM/SenseVoice

Terminology

• Benchmark — 24× in this paper · explained in 2 episodes
• Distillation — 24× in this paper · explained in 2 episodes
• LLM judge — 10× in this paper · explained in 2 episodes
• Foundation Model — 7× in this paper · explained in 3 episodes
• Grounding — 6× in this paper · explained in 3 episodes
• Agent Harness — 5× in this paper · explained in 2 episodes
• Aggregation — 5× in this paper · explained in 1 episode
• Alignment — 5× in this paper · explained in 1 episode
• Generative AI — 5× in this paper · explained in 2 episodes
• On-Policy Distillation — 5× in this paper · explained in 3 episodes
• Verification — 5× in this paper · explained in 2 episodes
• Foundation Models — 4× in this paper · explained in 7 episodes
• Reinforcement Learning — 4× in this paper · explained in 4 episodes
• AI Agents — 3× in this paper · explained in 2 episodes
• Adaptation — 3× in this paper · explained in 1 episode
• Calibration — 3× in this paper · explained in 7 episodes
• Cooperation — 3× in this paper · explained in 2 episodes
• Knowledge Distillation — 3× in this paper · explained in 11 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Agentic System — 2× in this paper · explained in 2 episodes
• Benchmarking — 2× in this paper · explained in 3 episodes
• Co-Playable Character — 2× in this paper
• Consistency — 2× in this paper · explained in 3 episodes
• Core — 2× in this paper · explained in 2 episodes
• Deep Reinforcement Learning — 2× in this paper · explained in 2 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Iterative Refinement — 2× in this paper · explained in 3 episodes
• Transformer — 2× in this paper · explained in 2 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Action Space — 1× in this paper · explained in 1 episode
• Agentic Architecture — 1× in this paper · explained in 1 episode
• Consistency Distillation — 1× in this paper · explained in 2 episodes
• Covariate Shift — 1× in this paper · explained in 2 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Flow Matching — 1× in this paper · explained in 8 episodes
• Frustration — 1× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
• Pairwise Comparisons — 1× in this paper · explained in 2 episodes
• Pruning — 1× in this paper · explained in 4 episodes
• Regret — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Structured Reasoning — 1× in this paper · explained in 3 episodes
• Synthetic Data Generation — 1× in this paper · explained in 5 episodes
• Tokenization — 1× in this paper · explained in 2 episodes

Sources

• GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
• $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
• Lumine: An Open Recipe for Building Generalist Agents in 3D Open Worlds
• GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Tasks
• CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation
• Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain
• Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
• AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
• Deliberative Alignment: Reasoning Enables Safer Language Models
• Distilling the Knowledge in a Neural Network
• Raon-Speech Technical Report
• WHALE: A Simple Recipe for Joint Harness-Weight Optimization
• Tulu 3: Pushing Frontiers in Open Language Model Post-Training
• Imitation Learning for Multi-turn LM Agents via On-policy Expert Corrections
• Meta-Harness: End-to-End Optimization of Model Harnesses
• Revisiting DAgger in the Era of LLM-Agents
• The Llama 3 Herd of Models
• AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents
• NitroGen: An Open Foundation Model for Generalist Gaming Agents

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection