Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety

summary

Video file (mp4)

The gist

The gist The Yuvion VL family of multimodal large language models was purpose-built for content and AI safety, treating safety as an inherently adversarial and multimodal problem.

In short

Yuvion VL is a family of multimodal large language models specifically designed for content and AI safety, treating safety as an adversarial problem. It uses an automated data pipeline and a three-stage training process, including Confuse-then-Contrast Fine-Tuning (C2FT), to make the model robust against harmful content while maintaining general capabilities.

Key concepts

Adversarial Robustness
This is the core design principle where the model is trained to resist malicious inputs. Instead of just learning what 'good' content looks like, it learns to identify and correctly classify subtle, dangerous variations in images or text that are intentionally designed to bypass safety filters. This makes the model safer against sophisticated attacks.
Confuse-then-Contrast Fine-Tuning (C2FT)
This is a specific training technique used to improve discrimination. It involves two steps: first, confusing the model with hard, tricky examples it struggles with, and second, contrasting those confusing examples against each other. This forces the model to learn very fine details that distinguish between visually similar but safety-implicated content.
Yuvion VL RiskEval (YVRE)
This is a comprehensive set of benchmarks used to rigorously test the model's safety performance. It includes three levels: testing if safety specialization hurts general skills, evaluating competence on public and internal safety tasks, and in-house benchmarks that simulate real-world production challenges.
Three-Stage Training Pipeline
The training process is broken into three distinct phases: continued pretraining to align risk concepts across different modalities (like images and text), instruct post-training for general safety tasks, and reasoning post-training to improve complex problem-solving and interpretability.

Terminology used across episodes

This episode discusses

The paper

Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety · Read on arXiv

Shikai Qiu, Xiaowen Xu, Benlei Cui, Ting Ma, Xiufeng Huang, Wenjing Jiang, Shaoxuan He, Haolei Xu, Chunyang Chai, Yujian Li

Alibaba Security AGI Lab

General-purpose models often struggle to reliably identify and understand real-world multimodal risks, largely due to the inherent multimodal adversarial nature of content and AI safety. We present Yuvion VL, a family of multimodal large language models purpose-built for content and AI safety, with both instruction-tuned and reasoning-oriented variants. Yuvion VL addresses this gap by treating safety as an inherently adversarial and multimodal problem and designing the entire pipeline around adversarial robustness. For data construction, we develop an automated pipeline integrating adversarial-aware data synthesis with multi-stage quality control, producing large-scale, high-quality multimodal samples augmented with domain knowledge and reasoning annotations. For training, we adopt a three-stage pipeline that includes continued pretraining for risk-concept cross-modal alignment, instruct post-training for production-grade safety tasks, and reasoning post-training for enhanced interpretability and performance in complex tasks. We further introduce Confuse-then-Contrast Fine-Tuning, a contrastive framework that mines model-specific confusions and constructs multi-image contrastive groups to enforce explicit discrimination of fine-grained visual-semantic elements, enabling the model to distinguish between visually similar cases with different safety implications in adversarial safety tasks. To support rigorous evaluation, we further introduce Yuvion VL RiskEval (YVRE), a collection of benchmarks covering diverse open and internal evaluations, with a focus on content and AI safety, adversarial robustness, and real-world capability requirements. Experiments show that Yuvion VL-32B achieves industry-leading safety performance, surpassing comparably sized open-source models and best closed-source commercial models, while maintaining comparable general capabilities.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Hi, I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety".

Jane: Here's the gist of the paper. The gist The Yuvion VL family of multimodal large language models was purpose-built for content and AI safety, treating safety as an inherently adversarial and multimodal problem.

Tom: How it works Yuvion VL addresses the gap in general-purpose models by designing the entire pipeline around adversarial robustness<ref:2606.25034#pg2>For data construction, they develop an automated pipeline integrating adversarial-aware data synthesis with multi-stage quality control, producing large-scale, high-quality multimodal samples augmented with domain knowledge and reasoning annotations<ref:2606.25034#pg2>For training, they adopt a three-stage pipeline that includes continued pretraining for risk-concept cross-modal alignment, instruct post-training for production-grade safety tasks, and reasoning post-training for enhanced interpretability and performance in complex tasks<ref:2606.25034#pg2>They further introduce Confuse-then-Contrast Fine-Tuning (C2FT), a contrastive framework that mines model-specific confusions and constructs multi-image contrastive groups to enforce explicit discrimination of fine-grained visual-semantic elements<ref:2606.25034#pg2>This C2FT framework operates through a two-phase framework: a Confuse phase that dynamically mines model-specific hard cases, and a Contrast phase that enforces explicit cross-image discrimination via joint multi-image supervision<ref:2606.25034#pg2>The training pipeline consists of three stages: Continued Pretraining for risk-concept cross-modal alignment, Instruct Post-Training (SFT + C2FT) for productiongrade safety tasks, and Reasoning Post-Training (SFT + RLVR) for chain-of-thought risk reasoning<ref:2606.25034#pg2>The continued pretraining stage focuses on risk-concept cross-modal alignment on top of the base model’s general-purpose vision-language pretraining, aiming to help the model associate visual risk signals with their corresponding semantic concepts<ref:2606.25034#pg2>The instruct post-training stage involves supervised fine-tuning on Domain Safety Data to inject production-grade safety tasks, and the instruct C2FT stage for adversarial pair contrastive training<ref:2606.25034#pg2>The reasoning post-training stage adopts a two-stage pipeline consisting of reasoning supervised fine-tuning (Reasoning SFT) and reasoning reinforcement learning (Reasoning RL)<ref:2606.25034#pg2>The Reasoning SFT component includes Knowledge Replay Data, which samples high-quality CPT-stage corpora into the SFT mixture as an approximate regularizer, preserving knowledge density<ref:2606.25034#pg2>The Reasoning RL component employs a Rejection Sampling approach to curate “high-value canonical samples,” focusing training on the model’s “cognitive blind spots” for targeted reinforcement<ref:2606.25034#pg2>The Reward Design for RL includes Format reward (schema valid), Decision accuracy, IoU for visual grounding, CoT–conclusion consistency, and Semantic similarity (subjective) multi-objective·dense reward<ref:2606.25034#pg2>Ablation studies show that Model-specific contrastive mining is essential for C2FT because it consistently outperforms random contrastive sampling<ref:2606.25034#pg2>The Progressive AntiShortcut Training (PAT) component prevents shortcut learning by randomly shuffling contrastive images and mixing multiimage samples with standard single-image samples<ref:2606.25034#pg2>The Yuvion VL RiskEval (YVRE) is a three-level progressive evaluation framework covering open-source general benchmarks, open-source safety benchmarks, and in-house capability and business benchmarks<ref:2606.25034#pg2>Level 1 tests whether safety specialization harms the base model’s general competence, requiring an aggregate degradation budget of ≤3 percentage points<ref:2606.25034#pg2>Level 2 evaluates content and AI safety competence through public benchmarks and self-constructed e-commerce governance benchmarks<ref:2606.25034#pg2>Level 3 is the most operationally grounded, aggregating more than 20 evaluation sets built from internal safety task logs and expert annotations<ref:2606.25034#pg2>The in-house benchmark results show that Yuvion VL delivers substantial and systematic gains on the in-house benchmark, surpassing both its base model and ultra-large models on production-critical dimensions<ref:2606.25034#pg2>Specifically, the Reasoning advantage over GPT-5.4 is similarly strong, with leads on SECURITY AUDIT (21 percentage points), CN TEXT IF (13 percentage points), and EN TEXT IF (10 percentage points)<ref:2606.25034#pg2>The C2FT framework enables the model to distinguish between visually similar cases with different safety implications without sacrificing general instruction-following ability<ref:2606.25034#pg2>In case studies, Yuvion VL is effective in cases where highseverity content is wrapped in a benign-looking visual framing, such as female chest exposure or deliberate genital exposure of minors<ref:2606.25034#pg2>It can identify risk elements that occupy only a tiny portion of the image and are easily overshadowed by benign context, such as a micro-scale Aum Shinrikyo emblem embedded in a phone home screen or a small nude painting pasted onto an engineering textbook cover<ref:2606.25034#pg2>The model's performance on AI-Generated Image Detection shows that domain-adapted training yields substantial improvements, with Yuvion VL-8B improving over its Qwen3-VL-8B backbone by +17.8 points<ref:2606.25034#pg2>This demonstrates that targeted safety training can compensate for model scale on this task<ref:2606.25034#pg2>The work concludes by presenting Yuvion VL as a family of multimodal foundation models purpose-built for adversarial content and AI safety<ref:2606.25034#pg2>This paper serves as a useful reference for future research and practice in multimodal risk governance<ref:2606.25034#pg2>The authors note that all sensitive data are collected from real-world moderation workflows under strict access control, stored in isolated environments, and not released publicly<ref:2606.25034#pg2>This work involves the construction and modeling of content safety data that by nature includes harmful and policy-violating material spanning categories such as pornography, violence, extremism, politically sensitive content, and fraud<ref:2606.25034#pg2>The authors hope Yuvion VL and the accompanying framework serve as a useful reference for future research and practice in multimodal risk governance<ref:2606.25034#pg2>The paper is available on arXiv as 2606.25034v2

cs.CV: 26 Jun 2026 1> How it works Yuvion VL addresses the gap in general-purpose models by designing the entire pipeline around adversarial robustness<ref:2606.25034#pg2>For data construction, they develop an automated pipeline integrating adversarial-aware data synthesis with multi-stage quality control, producing large-scale, high-quality multimodal samples augmented with domain knowledge and reasoning annotations<ref:2606.25034#pg2>For training, they adopt a three-stage pipeline that includes continued pretraining for risk-concept cross-modal alignment, instruct post-training for production-grade safety tasks, and reasoning post-training for enhanced interpretability and performance in complex tasks<ref:2606.25034#pg2>They further introduce Confuse-then-Contrast Fine-Tuning (C2FT), a contrastive framework that mines model-specific confusions and constructs multi-image contrastive groups to enforce explicit discrimination of fine-grained visual-semantic elements<ref:2606.25034#pg2>The C2FT framework operates through a two-phase framework: a Confuse phase that dynamically mines model-specific hard cases, and a Contrast phase that enforces explicit cross-image discrimination via joint multi-image supervision<ref:2606.25034#pg2>The training pipeline consists of three stages: Continued Pretraining for risk-concept cross-modal alignment, Instruct Post-Training (SFT + C2FT) for productiongrade safety tasks, and Reasoning Post-Training (SFT + RLVR) for chain-of-thought risk reasoning<ref:2606.25034#pg2>The continued pretraining stage focuses on risk-concept cross-modal alignment on top of the base model’s general-purpose vision-language pretraining, aiming to help the model associate visual risk signals with their corresponding semantic concepts<ref:2606.25034#pg2>The instruct post-training stage involves supervised fine-tuning on Domain Safety Data to inject production-grade safety tasks, and the instruct C2FT stage for adversarial pair contrastive training<ref:

Paper summary: Tom: So we're looking at the paper "Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety". The main point here is that general-purpose models really struggle to reliably spot and understand real-world risks because safety issues are inherently multimodal and adversarial.

Jane: That sounds like a big problem, Tom. So what's Yuvion VL trying to fix? What's the core claim they are making about this new model family?

Tom: They say Yuvion VL is purpose-built specifically for content and AI safety, so it has both instruction-tuned and reasoning variants. Their whole approach is treating safety as this adversarial and multimodal problem from the start, designing the entire training pipeline around being robust against those kinds of attacks.

Lu: I see they're tackling that gap by focusing on adversarial robustness across the board. What they are doing for data construction is pretty heavy—they have an automated pipeline that combines adversarial-aware data synthesis with multi-stage quality control to make sure the samples are large scale and high quality, and they add domain knowledge and reasoning annotations to it.

Meng: Data synthesis sounds cool, but how do you actually get those high quality samples? And what about the training process itself? Can we trust that this pipeline produces data that actually helps the model learn what it needs to learn?

Tom: They have a three-stage training pipeline. First, they have continued pretraining for risk-concept cross-modal alignment, which is basically helping the model associate visual risk signals with their corresponding semantic concepts. Then there's instruct post-training for production grade safety tasks, and finally reasoning post-training for better interpretability and performance in complex tasks.

Jane: That sounds like a lot of work. Can you tell us more about that reasoning part? How does that help the model actually reason through something risky? What’s the next thing they introduce to improve its discrimination capabilities?

Lu: They introduce Confuse-then-Contrast Fine-Tuning, or C2FT. This is a contrastive framework where they mine model specific confusions and build multi image contrastive groups to force the model to explicitly discriminate between fine grained visual semantic elements.

Meng: Contrastive frameworks are used a lot, but what does that actually achieve here? Does it just make the model better at spotting obvious things, or is it tackling something more subtle?

Paper summary: Lu: It's about mining those specific points where the model gets confused and then using joint multi image supervision in a contrast phase to enforce that explicit discrimination between similar images that have different safety implications.

Tom: So they have this C2FT operating in two phases: a confuse phase that dynamically mines hard cases, and then a contrast phase for cross image discrimination. This sounds like it's specifically targeting those tricky adversarial examples we talked about earlier.

Jane: That makes sense. When we think about the naive question people might ask, it's how does this help us in practice? If a user is trying to build an AI that needs to be safe, what does this model give them?

Lu: It gives them a model that is specifically engineered for deployment in real-world scenarios. They have released Yuvion VL in both 8B and 32B Dense variants, available in both instruct and reasoning versions <ref:2606.25034#pg3,in both instruct and reasoning versions>.

Meng: From a deployment standpoint, what's the trade off? Is it bigger models always better for safety, or is there a cost to that size? What breaks when you try to run this at scale?

Tom: They claim Yuvion VL-32B achieves industry leading safety performance, and they say it surpasses comparably sized open source models and best closed source commercial models while keeping comparable general capabilities <ref:2606.25034#pg1>.

Jane: That's a strong claim. And how do they prove that on the real world? What kind of evaluation framework are they using to test this safety performance?

Lu: They introduced Yuvion VL RiskEval, which is a three level progressive evaluation framework. Level one tests if safety specialization hurts general competence with an aggregate degradation budget of less than three percentage points.

Meng: Level two sounds like standard benchmarks, but what’s the most practical test they have? What about the stuff that actually happens when you put this into a product?

Lu: Level three is the most operationally grounded. It aggregates more than twenty evaluation sets built from internal safety task logs and expert annotations, and the in-house benchmark results show substantial gains on production critical dimensions.

Tom: And regarding reasoning specifically, their results show a reasoning advantage over GPT-five point four, with leads on things like SECURITY AUDIT at twenty-one percentage points. That’s a concrete comparison point they are using here.

Paper summary: Jane: So it's not just about spotting things, but about the model being able to reason through the risk itself, which is really important when you have complex stuff happening. What’s the biggest win for someone who just uses this for their daily work?

Lu: The C2FT framework allows it to distinguish between visually similar cases with different safety implications without sacrificing general instruction following ability. It can even catch risk elements that are only tiny parts of an image, like a micro scale emblem or a small nude painting on a textbook cover.

Meng: That ability to find those hidden elements is what I care about when I think about running this at scale. If the training pipeline is working, does it mean we don't have to manually curate thousands of specific adversarial examples?

Lu: The adversarial-aware data production pipeline generates large scale high quality multimodal training data that captures real world evasion strategies, including small text and watermark evasion, logo mutation, occlusion and concealment. It creates a data flywheel for continuously mining failure cases.

Tom: So the paper is presenting Yuvion VL as a family of multimodal foundation models specifically engineered for adversarial content and AI safety, with instruction tuned and reasoning oriented variants available in 8B and 32B sizes <ref:2606.25034#pg3,available in 8B and 32B>.

Jane: And what does that mean for the bigger picture? What is the ultimate purpose of creating these specialized models instead of just tuning existing ones?

Lu: The paper concludes by presenting Yuvion VL as a family of multimodal foundation models purpose built for adversarial content and AI safety, and they hope this work serves as a useful reference for future research and practice in multimodal risk governance.

Meng: That sounds like the authors are really focused on the real world application side, not just the pure research aspect. They've shown how targeted safety training can compensate for model scale on tasks like AI generated image detection, improving over models like Qwen3-VL-8B by seventeen point eight points.

Tom: So we've covered the thesis and what they claim about Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety. Next up, we’re going to talk about what this all means for the bigger picture in the conclusion section.

Conclusion: Tom: So we've been looking at Yuvion VL, this new family of multimodal models built specifically for content and AI safety. Now we get to the end of this deep dive where Jane and I talk about what that title actually means for us.

Jane: It basically means they didn’t just build another big model; they engineered one from the ground up with a focus on adversarial robustness across all its parts.

Tom: Yeah, it's not just about making a model that can answer questions well; it’s about making sure it doesn't get tricked into doing something harmful when faced with tricky visual or textual input.

Lu: The authors are treating safety as an inherently adversarial and multimodal problem, which means they designed the entire pipeline around being robust against those kinds of attacks from the start.

Meng: That sounds complicated to set up in a real production environment, especially getting that data synthesis right. How do you actually know if that adversarial-aware data is good enough for production?

Jane: They used multi-stage quality control in their data construction pipeline, which means they didn't just dump random bad stuff into the training set; they had checks along the way.

Tom: Exactly, and then you have this three-stage training pipeline that moves from aligning risk concepts across modalities to instruction tuning for safety tasks, and then finally reasoning post-training for better thinking.

Lu: And their Confuse-then-Contrast Fine-Tuning, C2FT framework is what really allows the model to distinguish between visually similar cases that have different safety risks.

Jane: So when you boil it down, Yuvion VL is aiming to be a foundation model that’s not just smart, but trustworthy in high-stakes situations.

Tom: It sounds like they're pushing toward models that can handle the nuanced stuff—the tiny risk signals hidden in complex images—without losing their general instruction following ability.

Meng: If we look at the results, they show that Yuvion VL-32B hits industry leading safety performance, even surpassing comparable open source and some closed source commercial models <ref:2606.25034#pg1>. That’s a solid number to look at for deployment.

Jane: It suggests that when you specifically tailor a foundation model for safety, you can get very high performance without necessarily needing the absolute biggest scale every time.

Tom: The implication is that for AI developers building systems where risk matters—whether it's content moderation or something else—the focus should be on this kind of targeted, robust training rather than just scaling up general capabilities blindly.

Jane: It opens up a new direction for how we think about governance, moving from just checking outputs to designing the model’s very core to resist manipulation.

Tom: This work is really about building a reference point for future research and practice in multimodal risk governance, so it’s definitely something worth keeping an eye on. (Outro music begins to fade in)

More episodes

← Home