IEEE Transactions on Instrumentation and Measurement · 2022 · 24 citations · 28 references
ComputingComputer ScienceIndustrial EngineeringComputer VisionMachine LearningMachine VisionDeep LearningDefect DetectionFeature DetectionIndustrial InspectionPattern RecognitionRepresentation LearningAccuracyAnchor-based DetectionAnchor-free DetectionCentroid ComputationCentroid EstimationDeep Image FeaturesKnowledge DistillationModel Complexity
Lightweight anchor-free detectors are currently gaining more and more popularity in the field of industrial defect detection. In general, it is difficult to achieve competitive performance compared to deep anchor-based detector. Knowledge distillation is an effective way to solve this problem. In this paper, we propose a novel anchor-free method based on knowledge distillation, called D-CenterNet. In our method, we employ an optimization approach using an adaptive label encoding strategy to better regress the centroid information of extreme aspect ratio (EAR) defects and improve detection accuracy. Backbone is improved for industrial defects with large aspect ratios and complex backgrounds, and strip pooling (SP) module is introduced to extract image features more efficiently. By redefining the distilled knowledge as the interrelationship between the output information, we train the student model using the pseudo-label generated by the teacher model, and then improve the model using the real label data to further enhance the performance of the student model without increasing model complexity. The experimental results on Aliyun Tianchi fabric dataset demonstrate that D-CenterNet achieves 75.5% mAP and increases the mAP of the student model (60.1%, before distillation) to 63.8% (after distillation) without increasing the complexity of the model. Extensive experimental results validate the superiority of our method and demonstrate that our D-CenterNet achieves state-of-the-art (SOTA) performance in both accuracy and real-time performance.
28
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Histograms of Oriented Gradients for Human Detection
Navneet Dalal, Bill Triggs · 2005 · 31.9K citations · Full text
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Ross Girshick, Jeff Donahue, Trevor Darrell et al. · 2014 · 31.8K citations
Kaiming He, Georgia Gkioxari, Piotr Dollár et al. · 2017 · 28.8K citations