English
Related papers

Related papers: Out-of-distribution generalisation is hard: eviden…

200 papers

Deep generative models (DGMs) seem a natural fit for detecting out-of-distribution (OOD) inputs, but such models have been shown to assign higher probabilities or densities to OOD images than images from the training distribution. In this…

Machine Learning · Computer Science 2021-07-20 Lily H. Zhang , Mark Goldstein , Rajesh Ranganath

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Test data is said to be out-of-distribution (OOD) when it unexpectedly differs from the training data, a common challenge in real-world use cases of machine learning. Although OOD generalisation has gained interest in recent years, few…

Computation and Language · Computer Science 2024-09-30 Dejan Porjazovski , Anssi Moisio , Mikko Kurimo

The ability of an agent to do well in new environments is a critical aspect of intelligence. In machine learning, this ability is known as $\textit{strong}$ or $\textit{out-of-distribution}$ generalization. However, merely considering…

Machine Learning · Computer Science 2024-02-09 Siyuan Guo , Jonas Wildberger , Bernhard Schölkopf

Despite the significant research efforts on trajectory prediction for automated driving, limited work exists on assessing the prediction reliability. To address this limitation we propose an approach that covers two sources of error, namely…

Robotics · Computer Science 2023-08-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

Detecting out-of-distribution (OOD) nodes in the graph-based machine-learning field is challenging, particularly when in-distribution (ID) node multi-category labels are unavailable. Thus, we focus on feature space rather than label space…

Machine Learning · Computer Science 2025-10-24 Shenzhi Yang , Junbo Zhao , Sharon Li , Shouqing Yang , Dingyu Yang , Xiaofang Zhang , Haobo Wang

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

In the open world, detecting out-of-distribution (OOD) data, whose labels are disjoint with those of in-distribution (ID) samples, is important for reliable deep neural networks (DNNs). To achieve better detection performance, one type of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Yingwen Wu , Ruiji Yu , Xinwen Cheng , Zhengbao He , Xiaolin Huang

Machine Learning classifiers used in Brain-Computer Interfaces make classifications based on the distribution of data they were trained on. When they need to make inferences on samples that fall outside of this distribution, they can only…

Machine Learning · Computer Science 2026-03-17 Merlijn Quincent Mulder , Matias Valdenegro-Toro , Andreea Ioana Sburlea , Ivo Pascal de Jong

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

LiDAR-based 3D object detection has become an essential part of automated driving due to its ability to localize and classify objects precisely in 3D. However, object detectors face a critical challenge when dealing with unknown foreground…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Michael Kösel , Marcel Schreiber , Michael Ulrich , Claudius Gläser , Klaus Dietmayer

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when…

Machine Learning · Computer Science 2022-04-01 Nanyang Ye , Kaican Li , Haoyue Bai , Runpeng Yu , Lanqing Hong , Fengwei Zhou , Zhenguo Li , Jun Zhu

Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits. We hypothesize that ``neural collapse'', a phenomenon affecting…

Machine Learning · Statistics 2024-02-28 Mouïn Ben Ammar , Nacim Belkhir , Sebastian Popescu , Antoine Manzanera , Gianni Franchi

This paper reexamines the research on out-of-distribution (OOD) robustness in the field of NLP. We find that the distribution shift settings in previous studies commonly lack adequate challenges, hindering the accurate evaluation of OOD…

Computation and Language · Computer Science 2023-10-27 Lifan Yuan , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Fangyuan Zou , Xingyi Cheng , Heng Ji , Zhiyuan Liu , Maosong Sun

Out-of-distribution (OOD) detection is essential for ensuring the reliability and safety of machine learning systems. In recent years, it has received increasing attention, particularly through post-hoc detection and training-based methods.…

Machine Learning · Statistics 2025-11-04 Mouïn Ben Ammar , David Brellmann , Arturo Mendoza , Antoine Manzanera , Gianni Franchi