IEEE Transactions on Automation Science and Engineering · 2025 · 10 citations · 23 references
ComputingComputer ScienceIndustrial EngineeringComputer VisionMachine LearningNatural Language ProcessingAnomaly DetectionDeep LearningFeature DetectionIndustrial InspectionObject DetectionRepresentation LearningAnomaly AnalysisDeep Learning-based Anomaly DetectionFlexible ManufacturingLarge Language ModelsMultimodal Feature FusionMultimodal Feature RepresentationMultimodal Language LearningVisual Knowledge Representation
Zero-shot anomaly detection (ZSAD) enables the inspection of unseen objects by bridging textual prompts and visual features, showing great potential in flexible manufacturing. While existing ZSAD methods rely on predefined prompts and struggle with unseen defects, Multimodal Large Language Models (MLLMs) offer promising solutions through their generative and interpretative capabilities. However, adapting MLLMs to Industrial Anomaly Detection (IAD) remains challenging due to fine-grained anomaly patterns and subtle visual distinctions. We propose VMAD (Visual-enhanced MLLM Anomaly Detection), a framework that enriches MLLM with visual IAD knowledge through two key components: a Defect-Sensitive Structure Learning scheme that transfers patch-similarities for improved discrimination, and a Locality-enhanced Token Compression that leverages multi-level local features for fine-grained detection. We also introduce RIAD, a comprehensive IAD dataset with detailed anomaly annotations. Extensive experiments on MVTec-AD, Visa, WFDD, and RIAD demonstrate VMAD’s superior performance. The dataset and code will be publicly available at https://github.com/denghuilin-cyber/VMAD.
23
Alexander M. Kirillov, Eric Mintun, Nikhila Ravi et al. · 2023 · 9.1K citations
MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
Paul Bergmann, Michael Fauser, David Sattlegger et al. · 2019 · 1.8K citations
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation
Jongheon Jeong, Taewan Kim, Dongqing Zhang et al. · 2023 · 363 citations
LISA: Reasoning Segmentation via Large Language Model
Xin Lai, Zhuotao Tian, Yukang Chen et al. · 2024 · 260 citations