An investigation of AI integration in sound designer workflows and experiences
summary
The gist
The gist: Current AI tools perform adequately in fast-consumption media contexts but lack the narrative sophistication required for high-end sound design (films, immersive experiences etc).
In short
AI tools are adequate for fast-consumption media but lack narrative sophistication for high-end sound design. The study found practitioners prefer AI to handle labor-intensive tasks like restoration and source separation, using tools with granular control rather than full automation. The main risk is professional unskilling, as reliance on these tools threatens foundational technical skills while raising ethical concerns about training data transparency.
Key concepts
- Production Paradigms
- These are the two distinct environments where sound design happens: ephemeral/high-consumption media (where speed and cost matter most) and high-fidelity/long-form production (where human designers keep total control). The AI tools used must adapt their function based on which paradigm is being used.
- Technical Bottlenecks
- These are specific, time-consuming tasks in sound design, such as cleaning up old audio (restoration), separating sounds from recordings (source separation), and organizing large sound libraries. Practitioners seek AI to solve these bottlenecks so they can focus on creative decisions.
- Granular Control Preference
- Sound designers prefer AI tools that allow them fine-tuned manipulation, such as using parametric synthesis engines or hybrid workflows, instead of fully automated generation. This preference shows a desire for the AI to extend their technical craft rather than replacing it completely.
Terminology used across episodes
This episode discusses
The paper
An investigation of AI integration in sound designer workflows and experiences · Read on arXiv
Queen Mary University of London
Artificial intelligence is increasingly being integrated into professional audio production workflows, yet a gap persists between the tools developers produce and the requirements of practising sound designers. This paper investigates this gap through a mixed-methods study comprising a survey of 76 practitioners and follow-up semi-structured interviews with 20 industry professionals. Results were analysed using descriptive statistical analysis and thematic analysis to identify patterns across both datasets. Five themes emerged from our analysis: Context, Workflow, Potential, Risks, and Right Use. Our work indicates that current AI tools perform adequately in fast-consumption media contexts but lack the narrative sophistication required for high-end sound design (films, immersive experiences etc). Practitioners demonstrate a preference for assistive, task-specific applications, particularly in audio restoration and library management, over end-to-end generative systems. This work contributes to the on-going discussion on the use of AI and AI-enhanced tools in the creative industries. We report on the current status of the field from the point of view of sound designers and creative audio practitioners, and offer a set of recommendation for sound technologist and developers based on our findings to guide the development of more informed AI tools for sound design.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "An investigation of AI integration in sound designer workflows and experiences".
Jane: The gist: Current AI tools perform adequately in fast-consumption media contexts but lack the narrative sophistication required for high-end sound design (films, immersive experiences etc).
Tom: First, who's behind it and why it matters.
Title and authors: Jane: Moving into the details, we have the title and authors of this paper: "An investigation of AI integration in sound designer workflows and experiences," by Nelly Garcia and Joshua Reiss.
Tom: Yeah, so they’re looking at how professionals are actually using AI in their jobs. The implication is that we need to look beyond just the technical capabilities of the models themselves.
Lu: They did a mixed-methods study, which means they combined an online survey with some semi-structured interviews to get a really broad view of how people feel about AI in this area.
Meng: And the survey reached quite a diverse group, seventy-six participants across twenty-one countries, and it showed that the sample was heavily weighted towards established professionals <ref:2605.27174#pg2>.
Jane: That’s interesting because it tells us that we aren't just talking to beginners here; we’re talking to people who already have significant experience in sound design.
Tom: The paper suggests that the way AI tools function depends entirely on the context—like whether you're doing quick content versus something high-fidelity and long-form.
Lalam: So it sets up this idea that the demands placed on AI tool design are different depending on whether you’re making something for fast consumption or a massive immersive experience.
The paper's summary: Tom: Now, let's look at what they actually found in the summary of "An investigation of AI integration in sound designer workflows and experiences." They’re saying that existing research often focuses too much on technical benchmarks and computational speed.
Jane: They argue that this focus on machine capability alone risks obscuring the actual creative processes designers use to make sound, which is what they call craft-based processes.
Lu: They point out that the demands of spatial audio and real-time interaction—which are really important for immersive work—place very distinct requirements on how AI tools are designed, and current generative models aren't quite meeting those needs yet.
Meng: This suggests that just having a powerful AI isn't enough; the tool has to be built with the specific needs of sound designers in mind.
Lalam: So they’re emphasizing that the requirements for AI tools are shaped by the actual workflow, not just by how fast it can process data.
Tom: They specifically address this gap by examining how participants perceive and use AI across different professional settings and under what conditions these technologies work as collaborative instruments.
Jane: The study looked at current tool usage, perceptions of creativity in AI, where the lines are between human and machine work, and even the ethical positions people take with these tools.
The paper's improvements: Tom: The paper suggests several ways to improve this situation. They emphasize that practitioners prefer tools that offer granular control over fully automated generation.
Lu: They highlight a clear preference for systems that allow for parametric and hybrid workflows, rather than just completely hands-off, fully automated generation.
Meng: This is significant because it shows that designers don't want to lose control; they want the AI to be an extension of their technical skill, not something that distances them from it.
Jane: The paper frames AI’s potential use as manipulating parameters and layering complex textures at speed, augmenting the iterative process while keeping the final creative decision with the designer.
Lalam: So, the suggested improvement is to build tools that let you manipulate specific settings and layer things quickly, but still leave you in charge of what happens next.
Tom: And they also point out a potential path for accessibility because cloud-based generative tooling can lower the barrier to entry for people who don't have access to expensive studio infrastructure or specialized training.
Conclusion: Jane: So, wrapping up the findings of "An investigation of AI integration in sound designer workflows and experiences," the paper suggests that AI’s value isn't measured by what it generates on its own, but how much it extends the practitioner’s capacity for deliberate, narratively intentional creative decisions.
Tom: It seems like they are arguing that the real measure of success for this technology in sound design is how well it supports a designer's specific creative intent.
Lu: I think the paper makes a strong case that we need to move beyond just looking at what the machine can produce and focus on how it lets us make deliberate choices.
Meng: And from an engineering standpoint, it means designing for those granular controls and parameter manipulation is actually where the most useful AI intervention will be found in these workflows.
Lalam: I agree; the paper points toward a future where AI helps speed up the utility tasks while leaving the high-level aesthetic choices firmly in human hands.
Jane: It’s a call for tools that respect the craft and honor the designer's role as a mediator in that creative process.
Tom: Alright, so we’ve covered how this paper looks at current AI integration in sound design workflows and experiences. That gives us a good idea of where the research is heading next.
More episodes
- 2601.08010-CASHEW: Stabilizing Multimodal Reasoning via Iterative Trajectory Aggregation
- Daily Summary for 2026-10-20
- 2609.19969-DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- 2309.01196-A Visual Interpretation-Based Self-Improved Classification System Using Virtual Adversarial Training
- 2504.20829-GaussTrap: Stealthy Backdoor Attacks on 3D Gaussian Splatting for Targeted Scene Misperception
- 2506.00060-Comparative analysis of privacy-preserving open-source LLMs regarding extraction of diagnostic information from clinical CMR imaging reports
- 2506.10974-AutoMind: Adaptive Knowledgeable Agent for Automated Data Science
- 2507.14056-Dynamic gain neuromodulation attenuates stability gaps during continual joint training
- 2508.03411-SlotMatch: Distilling Object-Centric Representations for Unsupervised Video Segmentation
- 2509.09009-Open-sci-ref-0.02: open reference baselines for reproducible language model and dataset comparison