English
Related papers

Related papers: Towards Robust Out-of-Distribution Generalization …

200 papers

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

Computer vision applications predict on digital images acquired by a camera from physical scenes through light. However, conventional robustness benchmarks rely on perturbations in digitized images, diverging from distribution shifts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Eunsu Baek , Keondo Park , Jiyoon Kim , Hyung-Sin Kim

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Robustness in terms of outliers is an important topic and has been formally studied for a variety of problems in machine learning and computer vision. Generalized median computation is a special instance of consensus learning and a common…

Machine Learning · Computer Science 2025-03-10 Andreas Nienkötter , Sandro Vega-Pons , Xiaoyi Jiang

Recently, generalization on out-of-distribution (OOD) data with correlation shift has attracted great attentions. The correlation shift is caused by the spurious attributes that correlate to the class label, as the correlation between them…

Machine Learning · Computer Science 2023-02-27 Mingyang Yi , Ruoyu Wang , Jiachen Sun , Zhenguo Li , Zhi-Ming Ma

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , Wenxuan Peng , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , Ziwei Liu

Out-of-distribution detection is a common issue in deploying vision models in practice and solving it is an essential building block in safety critical applications. Most of the existing OOD detection solutions focus on improving the OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tomas Vojir , Jan Sochman , Rahaf Aljundi , Jiri Matas

Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to evaluate the…

Machine Learning · Computer Science 2023-11-13 Russell Alan Hart , Linlin Yu , Yifei Lou , Feng Chen

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

As training datasets grow larger, we aspire to develop models that generalize well to any diverse test distribution, even if the latter deviates significantly from the training data. Various approaches like domain adaptation, domain…

Machine Learning · Computer Science 2024-10-10 Andreas Loukas , Karolis Martinkus , Ed Wagstaff , Kyunghyun Cho

Gradient-based learning algorithms have an implicit simplicity bias which in effect can limit the diversity of predictors being sampled by the learning procedure. This behavior can hinder the transferability of trained models by (i)…

Machine Learning · Computer Science 2022-11-24 Matteo Pagliardini , Martin Jaggi , François Fleuret , Sai Praneeth Karimireddy

When testing conditions differ from those represented in training data, so-called out-of-distribution (OOD) inputs can mar the reliability of learned components in the modern robot autonomy stack. Therefore, coping with OOD data is an…

In recent years, deep neural network (DNN) compression systems have proved to be highly effective for designing source codes for many natural sources. However, like many other machine learning systems, these compressors suffer from…

Machine Learning · Computer Science 2021-10-15 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

A major bottleneck in the real-world applications of machine learning models is their failure in generalizing to unseen domains whose data distribution is not i.i.d to the training domains. This failure often stems from learning…

Machine Learning · Computer Science 2021-09-28 Soroosh Shahtalebi , Jean-Christophe Gagnon-Audet , Touraj Laleh , Mojtaba Faramarzi , Kartik Ahuja , Irina Rish

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

Machine learning models often degrade when deployed on data distributions different from their training data. Challenging conventional validation paradigms, we demonstrate that higher in-distribution (ID) bias can lead to better…

Machine Learning · Computer Science 2025-06-03 Ruixuan Chen , Wentao Li , Jiahui Xiao , Yuchen Li , Yimin Tang , Xiaonan Wang

This paper proposes a method for OOD detection. Questioning the premise of previous studies that ID and OOD samples are separated distinctly, we consider samples lying in the intermediate of the two and use them for training a network. We…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Engkarat Techapanurak , Anh-Chuong Dang , Takayuki Okatani

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra