OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents
cs.SD, cs.AI
Submitted: 2026-09-20
Updated: 2026-09-23
Code: https://github.com/PKU-VaLuE-Lab/OmniEcho
Project page: https://internrobotics.github.io/internvla-n1.github.io/static/pdfs/InternVLA_N1.pdf
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Qwen2.5-VL Technical Report
- Learning to Set Waypoints for Audio-Visual Navigation
- PhaseCoder: Microphone Geometry-Agnostic Spatial Audio Understanding for Multimodal LLMs
- Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence
- Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigation
- Qwen3-TTS Technical Report
- SALM: Spatial Audio Language Model with Structured Embeddings for Understanding and Editing
- JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environments
- Ola: Pushing the Frontiers of Omni-Modal Language Model
- VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuning
- SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Models
- Seedance 2.0: Advancing Video Generation for World Complexity
- StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modeling
- Qwen2.5-Omni Technical Report
- Qwen3-Omni Technical Report
- The World is Not Mono: Enabling Spatial Understanding in Large Audio-Language Models
- GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot
- BAT: Learning to Reason about Spatial Sounds with Large Language Models
- Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding
Related papers
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
- SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
- WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
- Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment