中文
相关论文

相关论文: Distribution Shift Inversion for Out-of-Distributi…

200 篇论文

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Despite rapid advances in AI, safety remains the main bottleneck to deploying machine-learning systems. A critical safety component is out-of-distribution detection: given an input, decide whether it comes from the same distribution as the…

机器学习 · 计算机科学 2025-11-06 Joonas Järve , Karl Kaspar Haavel , Meelis Kull

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

机器学习 · 计算机科学 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

The superior performance of object detectors is often established under the condition that the test samples are in the same distribution as the training data. However, in many practical applications, out-of-distribution (OOD) instances are…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Tianhao Zhang , Shenglin Wang , Nidhal Bouaynaya , Radu Calinescu , Lyudmila Mihaylova

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

Reliable detection of out-of-distribution (OOD) inputs is increasingly understood to be a precondition for deployment of machine learning systems. This paper proposes and investigates the use of contrastive training to boost OOD detection…

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

机器学习 · 计算机科学 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

In this paper we introduce a new classification algorithm called Optimization of Distributions Differences (ODD). The algorithm aims to find a transformation from the feature space to a new space where the instances in the same class are as…

机器学习 · 计算机科学 2017-03-06 Mohammad Reza Bonyadi , Quang M. Tieng , David C. Reutens

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

机器学习 · 统计学 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

机器学习 · 计算机科学 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Large language models (LLMs) such as GPT-4 sometimes appear to be creative, solving novel tasks often with a few demonstrations in the prompt. These tasks require the models to generalize on distributions different from those from training…

计算与语言 · 计算机科学 2024-12-31 Jiajun Song , Zhuoyan Xu , Yiqiao Zhong

Out-of-distribution (OoD) detection for data-based programs is a goal of paramount importance. Common approaches in the literature tend to train detectors requiring inside-of-distribution (in-distribution, or IoD) and OoD validation…

计算机视觉与模式识别 · 计算机科学 2023-02-22 Romain Xu-Darme , Julien Girard-Satabin , Darryl Hond , Gabriele Incorvaia , Zakaria Chihani

We study the problem of efficiently detecting Out-of-Distribution (OOD) samples at test time in supervised and unsupervised learning contexts. While ML models are typically trained under the assumption that training and test data stem from…

机器学习 · 计算机科学 2024-05-13 Alberto Caron , Chris Hicks , Vasilios Mavroudis

A common challenge across all areas of machine learning is that training data is not distributed like test data, due to natural shifts, "blind spots," or adversarial examples; such test examples are referred to as out-of-distribution (OOD)…

机器学习 · 计算机科学 2021-10-29 Adam Tauman Kalai , Varun Kanade

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In…

机器学习 · 统计学 2021-03-05 Martin Arjovsky

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

机器学习 · 计算机科学 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

Machine learning models often encounter distribution shifts when deployed in the real world. In this paper, we focus on adaptation to label distribution shift in the online setting, where the test-time label distribution is continually…

机器学习 · 计算机科学 2022-01-06 Ruihan Wu , Chuan Guo , Yi Su , Kilian Q. Weinberger