English
Related papers

Related papers: Distribution Shift Inversion for Out-of-Distributi…

200 papers

We consider the problem of detecting OoD(Out-of-Distribution) input data when using deep neural networks, and we propose a simple yet effective way to improve the robustness of several popular OoD detection methods against label shift. Our…

Machine Learning · Computer Science 2022-07-04 Matteo Guarrera , Baihong Jin , Tung-Wei Lin , Maria Zuluaga , Yuxin Chen , Alberto Sangiovanni-Vincentelli

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

Machine Learning · Computer Science 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

Machine Learning · Computer Science 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Learning with identical train and test distributions has been extensively investigated both practically and theoretically. Much remains to be understood, however, in statistical learning under distribution shifts. This paper focuses on a…

Machine Learning · Computer Science 2024-11-01 Omar Montasser , Han Shao , Emmanuel Abbe

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

Machine Learning · Computer Science 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

We consider the task of out-of-distribution (OOD) generalization, where the distribution shift is due to an unobserved confounder ($Z$) affecting both the covariates ($X$) and the labels ($Y$). This confounding introduces heterogeneity in…

Machine Learning · Computer Science 2025-08-14 Parjanya Prashant , Seyedeh Baharan Khatami , Bruno Ribeiro , Babak Salimi

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

Machine Learning · Computer Science 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

One key challenge in Out-of-Distribution (OOD) detection is the absence of ground-truth OOD samples during training. One principled approach to address this issue is to use samples from external datasets as outliers (i.e., pseudo OOD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenjun Miao , Guansong Pang , Jin Zheng , Xiao Bai

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

Machine Learning · Computer Science 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

Machine Learning · Computer Science 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Existing out-of-distribution (OOD) detectors are often tuned by a separate dataset deemed OOD with respect to the training distribution of a neural network (NN). OOD detectors process the activations of NN layers and score the output, where…

Machine Learning · Computer Science 2026-02-06 Sudeepta Mondal , Xinyi Mary Xie , Ruxiao Duan , Alex Wong , Ganesh Sundaramoorthi

Deep Metric Learning (DML) aims to find representations suitable for zero-shot transfer to a priori unknown test distributions. However, common evaluation protocols only test a single, fixed data split in which train and test classes are…

Machine Learning · Computer Science 2021-11-30 Timo Milbich , Karsten Roth , Samarth Sinha , Ludwig Schmidt , Marzyeh Ghassemi , Björn Ommer

The ability to detect objects that are not prevalent in the training set is a critical capability in many 3D applications, including autonomous driving. Machine learning methods for object recognition often assume that all object categories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zizhao Li , Xueyang Kang , Joseph West , Kourosh Khoshelham