"Mirror" Large Language Model Evaluations of Depression are Criterion Contaminated

arXiv:2508.05830 · cs.CL, cs.CY · Submitted 2025-08-07 · Read on arXiv

cs.CL, cs.CY

Submitted: 2025-08-07

Updated: 2026-09-10

Comments: 48 pages, 10 figures

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Large Language Model — 12× in this paper
Accuracy — 10× in this paper · explained in 1 episode
Robustness — 7× in this paper · explained in 5 episodes
Clustering — 5× in this paper · explained in 2 episodes
Hallucination — 5× in this paper · explained in 3 episodes
Generalizability — 4× in this paper · explained in 6 episodes
Interpretability — 4× in this paper · explained in 15 episodes
Alignment — 3× in this paper · explained in 1 episode
Consistency — 2× in this paper · explained in 3 episodes
Embeddings — 2× in this paper · explained in 2 episodes
F1 Score — 2× in this paper · explained in 3 episodes
Grounding — 2× in this paper · explained in 3 episodes
Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
Mean Absolute Error — 2× in this paper
Mean Squared Error — 2× in this paper
Adaptation — 1× in this paper · explained in 1 episode
Core — 1× in this paper · explained in 2 episodes
Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
Montgomery-Asberg Depression Rating Scale — 1× in this paper
Named Entity Recognition (NER) — 1× in this paper · explained in 2 episodes

Sources

Related papers