English
Related papers

Related papers: Improving Robustness to Out-of-Distribution Data b…

200 papers

Improving the accuracy of deep neural networks (DNNs) on out-of-distribution (OOD) data is critical to an acceptance of deep learning (DL) in real world applications. It has been observed that accuracies on in-distribution (ID) versus OOD…

Machine Learning · Computer Science 2022-07-12 Sara Fridovich-Keil , Brian R. Bartoldson , James Diffenderfer , Bhavya Kailkhura , Peer-Timo Bremer

We consider the problem of detecting out-of-distribution images in neural networks. We propose ODIN, a simple and effective method that does not require any change to a pre-trained neural network. Our method is based on the observation that…

Machine Learning · Computer Science 2020-09-01 Shiyu Liang , Yixuan Li , R. Srikant

As the use of machine learning continues to expand, the importance of ensuring its safety cannot be overstated. A key concern in this regard is the ability to identify whether a given sample is from the training distribution, or is an…

Machine Learning · Computer Science 2023-08-11 Nicola Franco , Daniel Korth , Jeanette Miriam Lorenz , Karsten Roscher , Stephan Guennemann

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Neural networks have led to major improvements in image classification but suffer from being non-robust to adversarial changes, unreliable uncertainty estimates on out-distribution samples and their inscrutable black-box decisions. In this…

Machine Learning · Computer Science 2020-07-30 Maximilian Augustin , Alexander Meinke , Matthias Hein

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

Machine Learning · Computer Science 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

Machine Learning · Computer Science 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

Recently, the generalization behavior of Convolutional Neural Networks (CNN) is gradually transparent through explanation techniques with the frequency components decomposition. However, the importance of the phase spectrum of the image for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Guangyao Chen , Peixi Peng , Li Ma , Jia Li , Lin Du , Yonghong Tian

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. However, this assumption often fails in the presence of…

Machine Learning · Computer Science 2025-04-03 Chu Zhao , Enneng Yang , Yuliang Liang , Pengxiang Lan , Yuting Liu , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Current machine learning models achieve super-human performance in many real-world applications. Still, they are susceptible against imperceptible adversarial perturbations. The most effective solution for this problem is adversarial…

Machine Learning · Computer Science 2023-01-26 Mohammad Azizmalayeri , Arman Zarei , Alireza Isavand , Mohammad Taghi Manzuri , Mohammad Hossein Rohban