Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?".

Jane: The gist The single multimodal large language model (MLLM) struggles to excel simultaneously at detection, localization, description, and reasoning in multimodal industrial anomaly understanding (MM-IAU).

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So we're looking at this paper today, "Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?". It basically asks if just training a single multimodal large language model is enough to handle the whole job of finding, describing, and reasoning about defects in industrial settings.

Jane: The main point they’re making is that in-domain training doesn't close that gap between what models can do and what humans can do across all those different tasks.

Tom: That's right, so they look at a benchmark called MMAD, which covers seven different tasks for industrial anomaly understanding. And their finding is pretty sobering—trained specialists only reach at most seventy-five point five percent accuracy in defect localization on that benchmark, compared to ninety-two point three percent for actual human experts > <ref:2610.12310#pg1,reach at most 75.5% accuracy in defect localization>

Jane: And they also found that these trained specialists can sometimes detect anomalies less accurately than their untrained base models, which suggests the training isn't helping in the right way for everything >

Tom: Exactly. They point out that different multimodal models have complementary strengths, but they all share this weakness in fine-grained perception, so just combining them doesn't fix it >

Jane: So what they propose instead is something called SiGMA, which is a spatially grounded multi-agent framework that splits the work between different kinds of multimodal models and a dedicated visual defect expert >

Meng: That sounds like a lot of moving parts. How does this SiGMA actually work to solve the problem they identified in "Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?" >

Tom: Well, the SiGMA framework follows a search–reason–ground–aggregate workflow. First, there's a multimodal searcher that brings in industrial knowledge and normal references as context for all the agents >

Lu: That searcher is supposed to ground everything semantically while anchoring the normal appearance for both the agents and this defect expert >

Jane: Then you have these heterogeneous multimodal models, where each one independently produces a candidate prediction based on that context >

Meng: And then there’s this crucial part where a fine-grained defect expert steps in to localize query–reference discrepancies without relying on the MLLM's perception itself >

Tom: It goes from there to a calibration step, where that map is calibrated against normal residual statistics to suppress any unreliable responses >

Jane: And finally, there's this reliability controller that weighs each source based on its competence and the quality of the evidence it provides at query time >

Tom: So they’re using this combination of agents and expert to get a final answer by combining task-wise estimates with query-dependent evidence weighting >

Meng: It sounds like a very complex system, but what are the actual results they got when they tested this SiGMA framework on the MMAD benchmark? >

Jane: They found that SiGMA reaches an average accuracy of eighty-five point two percent on MMAD, which is four point zero percent above both JUDO and Gemini-two point five-Pro >

Tom: And they noted that its largest gains over the trained methods were in anomaly detection, where it was up by thirteen point eight percent, and defect localization was up by four point one percent >

Jane: That's a pretty big jump for those specific tasks, especially since they said composition lifts semantic tasks but doesn't improve perception >

Tom: They also found that adding the defect expert alone raised the average accuracy by two point zero percent, entirely through anomaly detection and defect localization, which is interesting because it bypasses the MLLM perception limitation > <ref:2610.12310#pg1>

Jane: And that reliability controller added another one point nine percent to the accuracy, with its biggest gains being in defect localization at six point zero percent and anomaly detection at two point one percent >

Tom: So they avoided updating any of the model parameters during this process, which is important for deployment because it means we don't have to retrain anything >

Lu: From a research perspective, what this implies is that you don't need one massive model to do everything; instead, dividing specialized tasks among different models and adding a dedicated expert can help when those models have different errors >

Meng: Practically speaking, if I were building something like this on my end, the inference cost scales with how many participating models there are >

Jane: Right, so while it adds complexity to the system architecture, it doesn't necessarily mean we need a single gigantic model to get good results for complex industrial tasks >

Tom: So what does this paper mean for us who just listen and aren't building the AI systems? It suggests that instead of relying on massive models getting better at everything through more training, a smarter architecture that divides labor might be the way forward >

Jane: It means we need to look at how we structure these multimodal AIs to intentionally separate perception from reasoning or description >

Tom: Exactly. The SiGMA framework shows that separating the task of identifying a physical defect from the general language understanding of an MLLM can actually improve performance in those specific areas >

Jane: It’s about moving away from hoping one giant model learns all these fine-grained details simultaneously, and instead building a system where different components handle what they do best >

Conclusion: Tom: So we're wrapping up our look at this paper, "Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?"

Jane: It really boils down to whether just teaching a single model more about industrial parts is enough to solve the whole problem of finding small defects and understanding them deeply.

Tom: Yeah, the authors are showing that in-domain training often leaves models uneven across all the different tasks they need to perform, like detection and localization.

Lu: It’s not just a matter of how much data you feed it; composition doesn't magically fix the perception weakness that most MLLMs share.

Meng: So if we look at the results, SiGMA is performing better than some trained methods, but they still trail human experts by a bit in those fine-grained visual tasks.

Lalam: The system they propose uses a lot of different models working together, and a separate expert that looks at the actual pixels instead of relying on just the language understanding.

Jane: It means we can't rely on one giant model getting better at everything; we have to build systems where different parts handle what they do best.

Tom: Exactly. The final accuracy they hit is around eighty-five point two percent, which is better than some of the specialized training methods they tested.

Lu: What’s really cool about their conclusion is that this whole SiGMA framework doesn't require any new model training to work; it just uses the models as frozen components.

Meng: That's a practical point for us because it means we don't have to spend months retraining massive models every time we want to adapt them for a new factory floor.

Jane: It suggests that instead of chasing bigger and bigger foundational models, focusing on how you structure the interaction between different specialized AI components is where the real gain is coming from.

Tom: It shows that dividing labor—giving one model a job for reasoning and another expert just to look at image patches—can actually boost performance in those tricky visual areas.

Lu: And they even show how the reliability controller estimates how trustworthy each model’s output is based on the evidence it sees at that exact moment.

Jane: So, the big picture here is moving away from hoping one monolithic AI learns all these tiny details at once, toward a more modular approach for industrial understanding.

Tom: And this leaves us wondering if this separation of concerns could be useful in other complex visual domains outside of just manufacturing defects.