An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations

arXiv:2607.21424 · cs.CL, cs.SD · Submitted 2026-07-23 · Read on arXiv

cs.CL, cs.SD

Submitted: 2026-07-23

Updated: 2026-09-24

Code: https://github.com/meta-llama/llama3

Terminology

LLM judge — 12× in this paper · explained in 2 episodes
Benchmark — 6× in this paper · explained in 2 episodes
Hallucination — 5× in this paper · explained in 3 episodes
LLM-as-a-Judge — 4× in this paper · explained in 3 episodes
Accuracy — 3× in this paper · explained in 1 episode
Calibration — 2× in this paper · explained in 7 episodes
Consistency — 2× in this paper · explained in 3 episodes
Core — 2× in this paper · explained in 2 episodes
Large Language Model — 2× in this paper
Large Language Model (LLM) — 2× in this paper · explained in 3 episodes
Universal Category System — 2× in this paper
Aggregation — 1× in this paper · explained in 1 episode
Alignment — 1× in this paper · explained in 1 episode
F1 Score — 1× in this paper · explained in 3 episodes
Foundation Model — 1× in this paper · explained in 3 episodes
Foundation Models — 1× in this paper · explained in 7 episodes
Generalization — 1× in this paper · explained in 13 episodes
Mean Absolute Error — 1× in this paper
Robustness — 1× in this paper · explained in 5 episodes

Sources

Related papers