Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images".

Jane: The gist The results imply that MLLMs can detect structural artefacts without relying on watermarks, but performance varies substantially across model generations.

Tom: First, who's behind it and why it matters.

Title and authors: Tom: So we're looking at this paper called "Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images." It’s about whether these multimodal models can actually tell if an image is fake without needing some sort of digital watermark.

Jane: That sounds really practical, Tom. Basically, the big question here is if we can use these large language models to do a forensic analysis—to spot synthetic media—by looking for physical inconsistencies instead of just checking for embedded watermarks.

Lu: The authors are using six different Multimodal Large Language Models: GPT-4o, GPT-five GPT-five point two, Gemini two point five, Gemini three and Seed one point six to test this idea across a dataset of four hundred images #pg1GPT-4oGPT-5GPT-5 point 2Gemini 2 point 5Gemini 3Seed one point six <ref:2610.21760#pg1,GPT-4o, GPT-5, GPT-5.2, Gemini 2.5, Gemini 3>

Meng: A dataset of four hundred images—that’s the baseline for this study—with fifty being real photographs and three hundred fifty being generated by seven leading image models like Gemini three GPT-Image-one and Seedream four point zero #pg1 <ref:2610.21760#pg1>

Lalam: The core focus is isolating text-to-image synthesis, meaning they are specifically looking at images made entirely from text prompts, rather than just face swaps or identity manipulation techniques #pg2

Tom: Right, and the structure of their test involves three main stages: single-image classification, pairwise comparison against other models, and a focused experiment specifically on how the models detect things themselves.

Jane: That’s interesting because they aren't just looking at one model in isolation; they are testing how well these systems work when they compare different types of AI detectors against each other.

Lu: The methodology involves building that custom four hundred-image corpus and then setting up those three experimental tiers to address specific hypotheses about detection performance and reliability #pg3

Meng: And a key part of the setup is this "Model Justification Audit," where they manually check the natural-language reasons the AI gives for its decisions to make sure it’s actually reasoning or just making guesses about what it sees #pg3

The paper's summary: Tom: So, to sum up "Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images," these researchers are showing that Multimodal Large Language Models can spot fake images without needing some hidden digital watermark.

Jane: It’s like they’re proving that the AI can look at the structure of an image, the physical details, and figure out it’s a forgery, instead of just checking for a specific sticker on it.

Lu: The core finding is that structural reasoning proves more reliable for forensic detection than relying on pixel-level data or any kind of metadata #pg3

Meng: I mean, so it’s not about the specific AI model you pick; it's about the underlying ability of the Multimodal Large Language Model to recognize physical inconsistencies in an image #pg3

Tom: Exactly. The study looked at six different models, and they found that GPT-five point two performed really well in a lot of tests, hitting nearly ninety-eight percent accuracy in one comparison #pg3 <ref:2610.21760#pg1>

Jane: And what’s interesting is how they handled the watermarks—they even found that removing those invisible SynthID signals actually hurt Gemini's detection accuracy by ten percent #pg3

Lu: The paper also pointed out that no hallucinations were recorded across any of the models in their manual audit, which suggests these models are doing genuine forensic reasoning rather than just guessing patterns #pg3

Meng: That’s a big deal for deployment because if they’re doing real reasoning, you can actually trust the justification they give you when they flag something #pg3

The paper's improvements: Tom: So, moving past the results, what are these authors suggesting we should do next with this research on detecting generated images #pg3

Jane: They’re basically saying we need to stop focusing so much on just one type of detection method and start focusing on the structural analysis aspect.

Lu: Yeah, they want to prioritize those structural artifacts over things like pixel-level noise or metadata because that’s where the reliable detection comes from #pg3

Meng: It means the next generation of detectors needs to be built around recognizing physical inconsistencies rather than just looking for a specific digital pattern #pg3

Tom: And they are calling out the masking phenomenon, which is when invisible watermarks actually hide those structural signals that these AI detectors need to work #pg3

Jane: They want the forensic community to reevaluate how we use invisible watermarking systems, not just for resisting attacks but for how they affect the structural signals #pg3

Lu: And they’re pointing out that because performance varies so much between different model generations, we can't just pick one detector and assume it will work everywhere #pg3

Meng: So, for the engineers shipping these models, the implication is that we need to stress-test these detectors against lower-quality imagery to make sure their reasoning holds up when the picture isn't perfect #pg3

Tom: I agree. They also suggested using degraded reference images in future experiments, like with "Ablated Anchors," to see if that performance drop is because of bad image quality or if the model can actually do the pairwise detection #pg3

Jane: And they want more human-baseline comparisons, so we get an idea of how these Multimodal Large Language Models’ justifications map against what actual human forensic experts see #pg3

Lu: They also mentioned that future audits should involve multiple auditors reviewing the AI's justifications and then averaging them to get a final verdict #pg3

Conclusion: Tom: So, to wrap up "Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images," these authors are showing that structural reasoning is a much more reliable way to spot fake images than relying on watermarks.

Jane: It’s about prioritizing those physical inconsistencies in the image over digital signatures, which is a big deal for how we think about deepfake detection.

Lu: The implication is that we need to design detectors that focus on those structural artifacts instead of just pixel-level or metadata-based approaches #pg3

Meng: For us in production, it means the next generation of detection systems has to be built around recognizing physical inconsistencies rather than just looking for a specific digital pattern #pg3

Lalam: I'm confident that structural reasoning is the way forward because no hallucinations were recorded across any of the six models in their manual audit #pg3

Tom: And they also pointed out that watermarking systems themselves might be creating a masking phenomenon, which is when invisible watermarks actually hide those structural signals that these AI detectors depend on #pg3

Jane: It seems like we have to rethink how we use invisible watermarking, not just for resisting attacks but for how they affect the structural signals #pg3

Lu: And because performance varies so much between model generations, we can't just pick one detector and assume it will work everywhere #pg3

Meng: So, the next step for us in production is to stress-test these new detectors against lower-quality imagery to make sure their reasoning holds up when the picture isn't perfect #pg3

Tom: And they suggested using degraded reference images in future experiments, like with "Ablated Anchors," to see if that performance drop is because of bad image quality or if the model can actually do the pairwise detection #pg3

Jane: They also want more human-baseline comparisons, so we get an idea of how these Multimodal Large Language Models’ justifications map against what actual human forensic experts see #pg3

Lu: And they also mentioned that future audits should involve multiple auditors reviewing the AI's justifications and then averaging them to get a final verdict #pg3