Exploring distribution-based approaches for out-of-distribution detection in deep learning models

Detecting unknown samples is a crucial task for deep learning applications, especially when considering open-set problems such as autonomous driving or disease classification. To improve DL models’ robustness in identifying unseen classes, out-of-distribution (OOD) methods are utilized to distinguis...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Neural computing & applications Ročník 37; číslo 17; s. 10807 - 10822
Hlavní autoři:	Carvalho, Thiago, Vellasco, Marley, Amaral, José Franco
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	London Springer London 01.06.2025 Springer Nature B.V
Témata:	Artificial Intelligence Computational Biology/Bioinformatics Computational Science and Engineering Computer Science Data Mining and Knowledge Discovery Deep learning Image Processing and Computer Vision Probabilistic models Probability and Statistics in Computer Science S.I.: Timely Advances of Deep Learning with applications and Data Driven Modeling Special Issue on Timely Advances of Deep Learning with applications and Data Driven Modeling Out-of-distribution detection Gaussian distribution Dirichlet Process Mixture Deep learning application
ISSN:	0941-0643, 1433-3058
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Popis
Shrnutí:	Detecting unknown samples is a crucial task for deep learning applications, especially when considering open-set problems such as autonomous driving or disease classification. To improve DL models’ robustness in identifying unseen classes, out-of-distribution (OOD) methods are utilized to distinguish between in-distribution (ID) and OOD samples using distinct patterns from the model’s output space. While utilizing the output space for OOD detection is common due to its practicality and effectiveness, relying solely on model scores may lead to issues such as overconfidence. In this study, we propose leveraging the logit distribution, with a focus on the Dirichlet Gaussian Mixture Models, to identify OOD samples. These approaches consider not only the score associated with the highest class but also those assigned to other classes. We evaluate different distributional assumptions and analyze the advantages and disadvantages of using Gaussian-based models for logit distribution in OOD detection. Based on the experiments of this work, the Dirichlet Gaussian Mixture approach obtained up to 27.5% improvement if compared to the best baseline strategy using the output space in the AUROC metric and 13.6% for the FPR95 metric.
Bibliografie:	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ISSN:	0941-0643 1433-3058
DOI:	10.1007/s00521-024-10912-w