OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Models

arXiv:2603.23938 · cs.CL · Submitted 2026-03-25 · Read on arXiv

cs.CL

Submitted: 2026-03-25

Updated: 2026-08-31

Terminology

• Benchmark — 35× in this paper · explained in 2 episodes
• Verification — 13× in this paper · explained in 2 episodes
• Alignment — 11× in this paper · explained in 1 episode
• Fidelity — 11× in this paper · explained in 2 episodes
• Grounding — 11× in this paper · explained in 3 episodes
• Accuracy — 7× in this paper · explained in 1 episode
• Benchmarking — 5× in this paper · explained in 3 episodes
• Feature Selection — 4× in this paper · explained in 4 episodes
• Failure Modes — 3× in this paper · explained in 3 episodes
• Multi-hop Reasoning — 3× in this paper · explained in 3 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Core — 2× in this paper · explained in 2 episodes
• Linear Probing — 2× in this paper · explained in 2 episodes
• Linear probe — 2× in this paper · explained in 2 episodes
• Multimodal Inputs — 2× in this paper · explained in 2 episodes
• Word Position Deviation — 2× in this paper
• Ablation Studies — 1× in this paper · explained in 1 episode
• Actor — 1× in this paper · explained in 3 episodes
• Affective Computing — 1× in this paper · explained in 1 episode
• Embeddings — 1× in this paper · explained in 2 episodes
• Feature Extraction — 1× in this paper · explained in 2 episodes
• Few-Shot Learning — 1× in this paper · explained in 4 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 2 episodes
• Lexical Deviation — 1× in this paper
• Lexical Diversity — 1× in this paper · explained in 2 episodes
• Multimodal Integration — 1× in this paper · explained in 2 episodes
• Phoneme Error Rate — 1× in this paper
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Semantic Drift — 1× in this paper · explained in 3 episodes
• Thinking mode — 1× in this paper · explained in 2 episodes
• Tokenization — 1× in this paper · explained in 2 episodes
• Visual Grounding — 1× in this paper · explained in 2 episodes
• Voiced Frame Ratio — 1× in this paper
• Words Per Minute — 1× in this paper

Sources

• UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Models
• FutureOmni: Evaluating Future Forecasting from Omni-Modal Context for Multimodal LLMs
• OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMs
• POWSM: A Phonetic Open Whisper-Style Speech Foundation Model
• BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
• Baichuan-Omni Technical Report
• OmniBench: Towards The Future of Universal Omni-Language Models
• WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
• Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
• S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models
• VocalBench: Benchmarking the Vocal Conversational Abilities for Speech Interaction Models
• OMHBench: Benchmarking Balanced and Grounded Omni-Modal Multi-Hop Reasoning
• See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models
• VoiceAssistant-Eval: Benchmarking AI Assistants across Listening, Speaking, and Viewing
• GLOBE: A High-quality English Corpus with Global Accents for Zero-shot Speaker Adaptive Text-to-Speech
• EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
• Learning Transferable Visual Models From Natural Language Supervision
• Qwen2.5-Omni Technical Report
• Qwen3-Omni Technical Report
• URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering