Auditory Illusion Benchmark for Large Audio Language Models

arXiv:2609.02277 · cs.SD, cs.AI · Submitted 2026-09-02 · Read on arXiv

cs.SD, cs.AI

Submitted: 2026-09-02

Updated: 2026-09-02

Code: https://github.com/gillosae/aib

Terminology

• Benchmark — 34× in this paper · explained in 2 episodes
• Alignment — 12× in this paper · explained in 1 episode
• Accuracy — 11× in this paper · explained in 1 episode
• Hallucination — 3× in this paper · explained in 3 episodes
• Perceptual Alignment — 3× in this paper · explained in 2 episodes
• Adaptation — 2× in this paper · explained in 1 episode
• Benchmarking — 2× in this paper · explained in 3 episodes
• Diagnostic Tools — 2× in this paper · explained in 2 episodes
• Few-Shot Learning — 1× in this paper · explained in 4 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Human-Likeness Accuracy — 1× in this paper
• Illusion Susceptibility Index — 1× in this paper
• Instruction Tuning — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Ontology — 1× in this paper · explained in 2 episodes
• Reality Alignment — 1× in this paper
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• AudioPaLM: A Large Language Model That Can Speak and Listen
• Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models
• Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities
• GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
• Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models
• Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
• SUPERB: Speech processing Universal PERformance Benchmark
• AudioBench: A Universal Benchmark for Audio Large Language Models
• MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
• AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
• MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
• IllusionBench+: A Large-scale and Comprehensive Benchmark for Visual Illusion Understanding in Vision-Language Models
• Voxtral
• Kimi-Audio Technical Report
• Fun-Audio-Chat Technical Report
• Qwen2-Audio Technical Report
• GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment