English
Related papers

Related papers: Out-of-distribution generalisation is hard: eviden…

200 papers

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow…

Machine Learning · Statistics 2020-06-16 Polina Kirichenko , Pavel Izmailov , Andrew Gordon Wilson

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

Machine Learning · Computer Science 2021-09-29 Jonathan S. Kent , Bo Li

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel molecules. Discovering novel molecules requires accurate out-of-distribution (OOD) predictions,…

The combination of behavioural cloning and neural networks has driven significant progress in robotic manipulation. As these algorithms may require a large number of demonstrations for each task of interest, they remain fundamentally…

Robotics · Computer Science 2026-01-28 Kiran Doshi , Marco Bagatella , Stelian Coros

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

Machine Learning · Computer Science 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

Machine Learning · Computer Science 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

Harnessing the power of diffusion models to synthesize auxiliary training data based on latent space features has proven effective in enhancing out-of-distribution (OOD) detection performance. However, extracting effective features outside…

Machine Learning · Computer Science 2025-11-25 Qilin Liao , Shuo Yang , Bo Zhao , Ping Luo , Hengshuang Zhao

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

This paper addresses the challenge of out-of-distribution (OOD) generalization in graph machine learning, a field rapidly advancing yet grappling with the discrepancy between source and target data distributions. Traditional graph learning…

Machine Learning · Computer Science 2024-08-09 Xin Sun , Liang Wang , Qiang Liu , Shu Wu , Zilei Wang , Liang Wang

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

Machine Learning · Computer Science 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

Machine Learning · Computer Science 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

Recently, there has been gradually more attention paid to Out-of-Distribution (OOD) performance prediction, whose goal is to predict the performance of trained models on unlabeled OOD test datasets, so that we could better leverage and…

Machine Learning · Computer Science 2025-11-03 Han Yu , Kehan Li , Dongbai Li , Yue He , Xingxuan Zhang , Peng Cui

Detecting out-of-distribution (OOD) data is critical for machine learning, be it for safety reasons or to enable open-ended learning. However, beyond mere detection, choosing an appropriate course of action typically hinges on the type of…

Machine Learning · Computer Science 2026-04-28 Achref Jaziri , Martin Rogmann , Martin Mundt , Visvanathan Ramesh