If You Hear It, Help Find It: Orthogonal Knowledge Distillation for Open-Vocabulary Audio-Visual Event Localization

arXiv:2609.23376 · cs.MM, cs.CV, cs.LG, cs.SD · Submitted 2026-09-20 · Read on arXiv

cs.MM, cs.CV, cs.LG, cs.SD

Submitted: 2026-09-20

Updated: 2026-09-20

Comments: Accepted to ACM Multimedia 2026 (poster). 9 pages, 5 figures

Code: https://github.com/ScottBlizzard/OV-OrthKD

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Distillation — 22× in this paper · explained in 2 episodes
• Alignment — 12× in this paper · explained in 1 episode
• Benchmark — 11× in this paper · explained in 2 episodes
• Knowledge Distillation — 11× in this paper · explained in 11 episodes
• AUROC — 9× in this paper · explained in 2 episodes
• Fine-Tuning — 7× in this paper · explained in 5 episodes
• Ablation — 5× in this paper · explained in 1 episode
• Transformer — 5× in this paper · explained in 2 episodes
• Robustness — 4× in this paper · explained in 5 episodes
• Grounding — 3× in this paper · explained in 3 episodes
• Regularization — 3× in this paper · explained in 3 episodes
• Cosine Similarity — 2× in this paper · explained in 3 episodes
• Multimodal Learning — 2× in this paper · explained in 2 episodes
• Pseudo-labeling — 2× in this paper · explained in 3 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Distribution Shift — 1× in this paper · explained in 6 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Linear probe — 1× in this paper · explained in 2 episodes
• Multimodal Fusion — 1× in this paper · explained in 3 episodes
• Ontology — 1× in this paper · explained in 2 episodes
• Representation Learning — 1× in this paper · explained in 2 episodes
• Temporal Reasoning — 1× in this paper · explained in 2 episodes
• Visual Grounding — 1× in this paper · explained in 2 episodes

Sources

• BEATs: Audio Pre-Training with Acoustic Tokenizers
• Decoupled Weight Decay Regularization
• OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment

Related papers

• ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling
• Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models
• Mitigating GenAI-powered Evidence Pollution for Out-of-Context Multimodal Misinformation Detection
• A Rate-Distortion-Classification Approach for Lossy Image Compression