English
Related papers

Related papers: Beyond Mahalanobis-Based Scores for Textual OOD De…

200 papers

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

Machine Learning · Computer Science 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

While Out-of-distribution (OOD) detection has been well explored in computer vision, there have been relatively few prior attempts in OOD detection for NLP classification. In this paper we argue that these prior attempts do not fully…

Artificial Intelligence · Computer Science 2021-11-09 Mrinal Rawat , Ramya Hebbalaguppe , Lovekesh Vig

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Deep learning models have become a popular choice for medical image analysis. However, the poor generalization performance of deep learning models limits them from being deployed in the real world as robustness is critical for medical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Anisie Uwimana1 , Ransalu Senanayake

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

Machine Learning · Computer Science 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

We consider the problem of detecting OoD(Out-of-Distribution) input data when using deep neural networks, and we propose a simple yet effective way to improve the robustness of several popular OoD detection methods against label shift. Our…

Machine Learning · Computer Science 2022-07-04 Matteo Guarrera , Baihong Jin , Tung-Wei Lin , Maria Zuluaga , Yuxin Chen , Alberto Sangiovanni-Vincentelli

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

Machine Learning · Computer Science 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Implementing effective control mechanisms to ensure the proper functioning and security of deployed NLP models, from translation to chatbots, is essential. A key ingredient to ensure safe system behaviour is Out-Of-Distribution (OOD)…

Computation and Language · Computer Science 2024-03-04 Maxime Darrin , Pablo Piantanida , Pierre Colombo

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

Computation and Language · Computer Science 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

Machine Learning · Computer Science 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

Reliable detection of out-of-distribution (OOD) inputs is increasingly understood to be a precondition for deployment of machine learning systems. This paper proposes and investigates the use of contrastive training to boost OOD detection…

Multimodal fusion, leveraging data like vision and language, is rapidly gaining traction. This enriched data representation improves performance across various tasks. Existing methods for out-of-distribution (OOD) detection, a critical area…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jinglun Li , Xinyu Zhou , Kaixun Jiang , Lingyi Hong , Pinxue Guo , Zhaoyu Chen , Weifeng Ge , Wenqiang Zhang