2023 · 30 citations · 33 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningObject RecognitionPattern RecognitionMachine Learning Detection ModelsMachine Learning Scoring ModelsMetricsOut-of-distribution Detection
Out‑of‑distribution detection is essential for machine‑learning models in open‑world settings, yet classifier‑based scores—though fine‑grained—often over‑confidently misclassify samples far from the in‑distribution manifold. The authors propose Nearest Neighbor Guidance (NNGuide) to align classifier‑based scores with the data manifold boundary. NNGuide operates by guiding classifier scores using nearest‑neighbor information and is evaluated on ImageNet OOD benchmarks across varied settings, including natural distribution shifts. NNGuide lowers overconfidence while maintaining fine‑grained detection, yielding significant performance gains and state‑of‑the‑art results on AUROC, FPR95, and AUPR.
Detecting out-of-distribution (OOD) samples are crucial for machine learning models deployed in open-world environments. Classifier-based scores are a standard approach for OOD detection due to their fine-grained detection capability. However, these scores often suffer from overconfidence issues, misclassifying OOD samples distant from the in-distribution region. To address this challenge, we propose a method called Nearest Neighbor Guidance (NNGuide) that guides the classifier-based score to respect the boundary geometry of the data manifold. NNGuide reduces the overconfidence of OOD samples while preserving the fine-grained capability of the classifier-based score. We conduct extensive experiments on ImageNet OOD detection benchmarks under diverse settings, including a scenario where the ID data undergoes natural distribution shift. Our results demonstrate that NNGuide provides a significant performance improvement on the base detection scores, achieving state-of-the-art results on both AUROC, FPR95, and AUPR metrics.
33
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Mark Sandler, Andrew Howard, Menglong Zhu et al. · 2018 · 25.4K citations
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. · arXiv (Cornell University) · 2020 · 21.6K citations · Full text