Evaluating Prompt Robustness in Text-to-Audio Systems for Adaptive Virtual Agents and Game Soundtracks

arXiv:2603.13824 · cs.SD, cs.AI · Submitted 2026-03-14 · Read on arXiv

cs.SD, cs.AI

Submitted: 2026-03-14

Updated: 2026-09-14

Comments: 4 pages, 2 figures. Poster paper published in the Proceedings of the ACM International Conference on Intelligent Virtual Agents (IVA 2026)

Journal ref: Proc. ACM International Conference on Intelligent Virtual Agents (IVA 2026), ACM, 2026

DOI: 10.1145/3806774.3832791

Code: https://github.com/declare-lab/tango

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Robustness — 29× in this paper · explained in 5 episodes
• Alignment — 17× in this paper · explained in 1 episode
• Cosine Similarity — 17× in this paper · explained in 3 episodes
• Structural Rephrasing — 15× in this paper
• Intensity Shifts — 9× in this paper
• Minimal Lexical Substitution — 9× in this paper
• Consistency — 7× in this paper · explained in 3 episodes
• Semantic Alignment — 6× in this paper · explained in 3 episodes
• Embeddings — 4× in this paper · explained in 2 episodes
• Abstraction — 2× in this paper · explained in 1 episode
• Contrastive Learning — 2× in this paper · explained in 5 episodes
• Core — 2× in this paper · explained in 2 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Semantic Similarity — 2× in this paper · explained in 2 episodes
• Alternation — 1× in this paper · explained in 1 episode
• Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Downstream Tasks — 1× in this paper · explained in 2 episodes
• Feature Extraction — 1× in this paper · explained in 2 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Latent Diffusion Model — 1× in this paper · explained in 2 episodes
• Latent Diffusion Models — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Transformer Architecture — 1× in this paper · explained in 2 episodes

Sources

• CLAP: Learning Audio Concepts From Natural Language Supervision
• AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
• Long-Form Text-to-Music Generation with Adaptive Prompts: A Case Study in Tabletop Role-Playing Games Soundtracks
• AI-Assisted Music Production: A User Study on Text-to-Music Models
• On The Open Prompt Challenge In Conditional Audio Generation

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment