English
Related papers

Related papers: Understanding Out-of-distribution: A Perspective o…

200 papers

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

Computation and Language · Computer Science 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

Machine Learning · Computer Science 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Recent years have witnessed significant progress in the development of machine learning models across a wide range of fields, fueled by increased computational resources, large-scale datasets, and the rise of deep learning architectures.…

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Despite agreement on the importance of detecting out-of-distribution (OOD) examples, there is little consensus on the formal definition of OOD examples and how to best detect them. We categorize these examples by whether they exhibit a…

Computation and Language · Computer Science 2021-12-16 Udit Arora , William Huang , He He

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

Machine Learning · Computer Science 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow…

Machine Learning · Statistics 2020-06-16 Polina Kirichenko , Pavel Izmailov , Andrew Gordon Wilson

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

We study the problem of efficiently detecting Out-of-Distribution (OOD) samples at test time in supervised and unsupervised learning contexts. While ML models are typically trained under the assumption that training and test data stem from…

Machine Learning · Computer Science 2024-05-13 Alberto Caron , Chris Hicks , Vasilios Mavroudis

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

Machine Learning · Computer Science 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk
‹ Prev 1 2 3 10 Next ›