Nearest Neighbor Guidance for Out-of-Distribution Detection

Jaewoo Park, Yoon Gyo Jung, Andrew Beng Jin Teoh

2023 · 30 citations · 33 references

Concepts

TL;DR

Out‑of‑distribution detection is essential for machine‑learning models in open‑world settings, yet classifier‑based scores—though fine‑grained—often over‑confidently misclassify samples far from the in‑distribution manifold. The authors propose Nearest Neighbor Guidance (NNGuide) to align classifier‑based scores with the data manifold boundary. NNGuide operates by guiding classifier scores using nearest‑neighbor information and is evaluated on ImageNet OOD benchmarks across varied settings, including natural distribution shifts. NNGuide lowers overconfidence while maintaining fine‑grained detection, yielding significant performance gains and state‑of‑the‑art results on AUROC, FPR95, and AUPR.

Abstract

Detecting out-of-distribution (OOD) samples are crucial for machine learning models deployed in open-world environments. Classifier-based scores are a standard approach for OOD detection due to their fine-grained detection capability. However, these scores often suffer from overconfidence issues, misclassifying OOD samples distant from the in-distribution region. To address this challenge, we propose a method called Nearest Neighbor Guidance (NNGuide) that guides the classifier-based score to respect the boundary geometry of the data manifold. NNGuide reduces the overconfidence of OOD samples while preserving the fine-grained capability of the classifier-based score. We conduct extensive experiments on ImageNet OOD detection benchmarks under diverse settings, including a scenario where the ID data undergoes natural distribution shift. Our results demonstrate that NNGuide provides a significant performance improvement on the base detection scores, achieving state-of-the-art results on both AUROC, FPR95, and AUPR metrics.

References

33