Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Next we'll be talking about the paper "Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models".

Jane: The paper was written by Yi-Cheng Lin, Wei-Chih Chen and Hung-yi Lee from National Taiwan University.

Tom: Stay tuned as we take you through the paper and discuss its implications.

Jane: We also have Lu with us today — senior AI researcher at Tsinghua.

Tom: We also have Meng with us today — lead engineer at a mysterious AI startup.

Jane: We also have Lalam with us today — the in-house Large Language Model.

Tom: Alright, let's get started.

Title and Authors: Tom: Alright, welcome back to the show, everybody. Today we’re digging into a brand new paper that just hit arXiv, and it’s called “Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models.” Jane, I gotta say, the title alone got me excited — we’re finally talking about bias in speech models, not just text.

Jane: Absolutely, Tom. And the authors — Yi-Cheng Lin, Wei-Chih Chen, and Hung-yi Lee from National Taiwan University — they’ve put together something really clever here. They took the idea of measuring stereotypes in text models and brought it into the speech world. That’s a big deal because speech carries so much more than just words.

Tom: Right, and that’s what I love about this. When you hear someone speak, you pick up on their age, their gender, maybe their accent, their tone. Text just doesn’t have that. So if we’re building these speech large language models, we need to know — are they making judgments based on how someone sounds, not just what they say?

Jane: Exactly. And that’s the core question they’re asking. They built a dataset called Spoken Stereoset, which is the first of its kind, specifically designed to test whether these models show social bias toward the speaker. And they focus on two big ones — gender and age.

Tom: And here’s the kicker — they actually found that most of the models they tested showed very little bias. But one model, SALMONN 13B, showed a slight tendency to go against stereotypes in the age category. So it’s not all clean, but it’s a really promising start.

Jane: Yeah, and I think the bigger implication here is that we now have a tool to actually measure this stuff. Before this paper, we were kind of flying blind. We knew speech models might be biased, but we had no way to quantify it. Now we do.

Tom: And that’s huge for the field. I mean, think about all the applications — voice assistants, customer service bots, even healthcare advice. If these models are biased against certain voices, that could have real consequences for real people.

Jane: Totally. And the authors were careful to note that the dataset is based on US cultural norms, so it’s not universal. But it’s a starting point, and it opens the door for more research in this area.

Tom: Well said, Jane. Now, let’s get into the meat of the paper — how they actually built this dataset and what makes it so clever. That’s coming up next.

Summary of the Paper: Tom: So Jane, we’re back, and we’ve got the full picture of the paper now. Let’s talk about what they actually did. They built this dataset called Spoken Stereoset, and it’s based on earlier work like StereoSet and CrowS-Pairs, but they adapted it for speech.

Jane: Right, and the clever part is how they rewrote everything. They took sentences from those text-based datasets and changed them to be first-person, so the biased target is always the speaker. That way, the model can’t just pick up on semantic clues in the text — it has to actually listen to the voice to make a judgment.

Tom: And then they synthesized the speech using text-to-speech APIs. For the gender part, they used Azure TTS with three male and three female speakers. For the age part, they used Topmediai TTS with four elderly speakers, four young speakers, and three child speakers.

Jane: And each audio clip has three possible continuations — one stereotypical, one anti-stereotypical, and one irrelevant. The model has to pick which one fits best. That’s how they measure bias. If a model consistently picks the stereotypical continuation for a female speaker but the anti-stereotypical one for a male speaker, that’s a bias signal.

Tom: And they didn’t just make this up in a lab. They hired annotators from the US, through Prolific, to listen to the audio and verify that the continuations actually matched the stereotype categories. They required at least fifty percent agreement among five annotators, and anything below that got thrown out.

Jane: That’s really thorough. And the final dataset has two thousand eight hundred forty-seven instances for gender and seven hundred ninety-three for age, across seventeen speakers total. They also checked diversity using ROUGE-L scores, and everything came in below zero point one three, which means the continuations are really different from each other — so the models can’t just pick based on word overlap.

Tom: Then they tested four speech large language models — Qwen-Audio-Chat, LTU-AS, SALMONN 7B, and SALMONN 13B. And they used three metrics: one for instruction following, one for language modeling quality, and one for bias. The bias score is the key one — closer to fifty means less biased.

Jane: And the results were actually pretty encouraging. Most models scored close to fifty on the bias metric, meaning they weren’t favoring stereotypes. But SALMONN 13B scored forty-four point four three on the age domain, which means it actually preferred anti-stereotypical continuations. That’s a different kind of bias — it’s like the model overcorrecting.

Tom: And they also ran a text-only version of the experiment, where they gave the models the transcription instead of the audio. And in that case, the bias scores were even closer to fifty across the board. That tells us the bias we do see is coming from the speech encoder, not the language model itself.

Jane: Exactly. That’s a really important finding. It means the bias is introduced when the model processes the audio, not when it reads the text. So if we want to fix it, we need to focus on the speech encoding part.

Tom: Alright, so we’ve got the dataset, we’ve got the results. But what does this mean for the future? What improvements are they suggesting? That’s our next topic.

Improvements Suggested by the Paper: Tom: So Jane, we’ve covered the dataset and the results. Now let’s talk about what the authors think we should do next. What improvements are they suggesting?

Jane: Well, first and foremost, they’re clear that this is just a starting point. The dataset is limited to gender and age, and it’s based on US cultural norms. So one big improvement is expanding it to more categories — race, accent, maybe even socioeconomic status.

Tom: And they also mention adding more speakers. Right now they have seventeen speakers total, which is decent, but it’s not a huge variety. More voices from different regions, different dialects, different age groups would make the dataset more robust.

Jane: Absolutely. And they also talk about the need for ongoing evaluation. Bias isn’t a one-time check. As models get updated, their biases can shift. So having a benchmark like Spoken Stereoset that can be used repeatedly is really valuable.

Tom: And here’s something I found interesting — they suggest that the bias we see is coming from the speech encoder, not the language model. So the improvement there is to focus on training the speech encoder with more diverse data, and maybe even adding explicit debiasing techniques during training.

Jane: Right, and that’s a practical suggestion. If you know the bias is in the encoder, you can target your efforts there. You don’t have to retrain the whole model. That saves a lot of compute and time.

Tom: And they also highlight the importance of using diverse and representative data in training. That’s a big one. If you train a speech model mostly on standard American English, it’s going to struggle with other accents and dialects. And that struggle can lead to biased responses.

Jane: Exactly. And they’re not just talking about accuracy — they’re talking about fairness. If a model gives worse advice to someone with a regional accent, that’s a real problem. The authors are saying we need to be intentional about who’s represented in the training data.

Tom: And there’s also a note about the ethical side. They’re very careful to say this dataset should only be used for evaluation, not for training models to generate biased language. That’s an important guardrail.

Jane: Yeah, that’s a responsible approach. And I think it sets a good example for other researchers building bias evaluation datasets. You have to think about how your work could be misused and address that head-on.

Tom: So the improvements are clear — bigger dataset, more categories, targeted debiasing of the speech encoder, and ongoing evaluation. That’s a solid roadmap for the field.

Jane: It really is. And I think the most exciting part is that this opens up a whole new area of research. We’re not just talking about text bias anymore. We’re talking about bias in how we hear and interpret voices. That’s a big deal.

Tom: Couldn’t agree more. Now let’s bring in Lu, Meng, and Lalam to get their take on all this. That’s coming up in the conclusion.

Conclusion: Tom: Alright, we’ve covered the dataset, the results, and the suggested improvements for “Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models.” Now let’s bring in the rest of the team to wrap this up.

Jane: Yeah, Lu, you’ve been quiet. What do you think about the potential here?

Lu: I think the most exciting implication is that we now have a way to isolate where bias enters the system. The fact that they showed the bias comes from the speech encoder, not the language model, is huge. That means we can build modular fixes instead of retraining everything.

Meng: And from an engineering standpoint, that’s exactly what we need. If I can swap out or fine-tune just the encoder, that’s a much smaller change. It’s more efficient, and it’s easier to test. I also appreciate that they used GPT-4o to evaluate the model responses — that’s a practical approach that scales.

Tom: And Lalam, what’s your take? You’re the one who sees the big picture.

Lalam: I see this as a step toward more inclusive technology. Speech is how most people interact with devices, and if those devices carry hidden biases, they can reinforce social inequalities. By giving us a tool to measure and correct that, this paper helps create a future where technology serves everyone equally, regardless of how they sound.

Jane: That’s a beautiful way to put it. And I think it’s worth saying that the authors were really careful about the limitations — they noted that the dataset is US-centric and that a low bias score doesn’t mean the model is unbiased everywhere.

Tom: Right, and that humility is important. They’re not claiming to have solved bias. They’re giving us a starting point, and they’re being honest about what it can and can’t do.

Meng: And honestly, the fact that most models showed minimal bias is a good sign. It means the field is on the right track, but we still need to watch for those edge cases like SALMONN 13B’s anti-stereotypical tendency.

Lu: Exactly. Bias isn’t just about favoring stereotypes — it can also be about overcorrecting. Both are problematic. And this dataset catches both.

Jane: Well said, everyone. So to wrap it up — “Spoken Stereoset” is the first dataset designed to measure social bias in speech large language models, and it’s a solid foundation for future work. We’re excited to see where this line of research goes.

Tom: And with that, we’re saying goodbye to this paper. Thanks for tuning in, and we’ll be back with the next one soon. Take care, everyone.