A Brief AI Literacy Intervention Does Not Significantly Reduce Over-Reliance and Increases Under-Reliance on ChatGPT: A Randomized Study

arXiv:2503.10556 · cs.CY, q-bio.NC · Submitted 2025-03-13 · Read on arXiv

cs.CY, q-bio.NC

Submitted: 2025-03-13

Updated: 2026-09-18

Terminology

• AI Literacy — 29× in this paper · explained in 1 episode
• Hallucination — 6× in this paper · explained in 4 episodes
• Prompt Engineering — 5× in this paper · explained in 4 episodes
• EMMA — 3× in this paper · explained in 2 episodes
• Core — 2× in this paper · explained in 2 episodes
• Homogeneity — 2× in this paper · explained in 2 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Adaptive Mechanism — 1× in this paper · explained in 1 episode
• Covariate Shift — 1× in this paper · explained in 2 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Hallucination Mitigation — 1× in this paper · explained in 2 episodes
• Metacognition — 1× in this paper · explained in 5 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Student-AI Interaction: A Case Study of CS1 students
• To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Models
• A Categorical Archive of ChatGPT Failures
• Performance and Metacognition Disconnect when Reasoning in Human-AI Interaction
• Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing
• Bending the Automation Bias Curve: A Study of Human and AI-based Decision Making in National Security Contexts
• Mapping the Increasing Use of LLMs in Scientific Papers
• A Comprehensive Overview of Large Language Models
• A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models
• Large Language Models for Education: A Survey and Outlook
• Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs

Related papers

• Reasoning Enhances Robustness to Prompt Injection in LLM-Based Consensus
• Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot
• PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks
• What is an intelligent system?
• AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
• Generative AI Use in Entrepreneurship: An Integrative Review and an Empowerment-Entrapment Framework