How Real Is AI Tutoring? Comparing Simulated and Human Dialogues in One-on-One Instruction

arXiv:2509.01914 · cs.AI, cs.CL, cs.MA · Submitted 2025-09-02 · Read on arXiv

cs.AI, cs.CL, cs.MA

Submitted: 2025-09-02

Updated: 2025-09-02

Comments: Proceedings of the 33rd International Conference on Computers in Education (ICCE 2025). Asia-Pacific Society for Computers in Education

Journal ref: Li, R., Jiang, Y.-H., Wang, J., & Jiang, B. (2025, December). How real is AI tutoring? Comparing simulated and human dialogues in one-on-one instruction. Proceedings of the 33rd International Conference on Computers in Education

DOI: 10.58459/icce.2025.6066

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Epistemic Network Analysis — 6× in this paper
• Scaffolding — 6× in this paper · explained in 3 episodes
• Simplistic Response — 6× in this paper
• Artificial Intelligence — 4× in this paper
• Core — 4× in this paper · explained in 2 episodes
• Factual Response — 4× in this paper
• Generative AI — 3× in this paper · explained in 2 episodes
• AI Agents — 2× in this paper · explained in 2 episodes
• Cognitive Scaffolding — 2× in this paper · explained in 3 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Agentic Workflows — 1× in this paper · explained in 1 episode
• Artificial Intelligence (AI) — 1× in this paper · explained in 2 episodes
• Benchmark — 1× in this paper · explained in 2 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Ensemble Learning — 1× in this paper · explained in 2 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Hierarchical Classification — 1× in this paper · explained in 2 episodes
• Hybrid Approach — 1× in this paper · explained in 4 episodes
• Knowledge Graph — 1× in this paper · explained in 7 episodes
• Knowledge graphs — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Learning-by-teaching with ChatGPT: The effect of teachable ChatGPT agent on programming education
• Doc-CoB: Enhancing Document Understanding with Visual Chain-of-Boxes Reasoning
• Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges
• IntelliChain: An Integrated Framework for Enhanced Socratic Method Dialogue with LLMs and Knowledge Graphs
• CGMI: Configurable General Multi-Agent Interaction Framework
• GPT-4 Technical Report

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection