English
Related papers

Related papers: Towards IID representation learning and its applic…

200 papers

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Out-of-Distribution (OOD) detection is crucial for the secure deployment of machine learning models, and prototype-based learning methods are among the mainstream strategies for achieving OOD detection. Existing prototype-based learning…

Machine Learning · Computer Science 2026-03-18 Ningkang Peng , Qianfeng Yu , Xiaoqian Peng , Linjing Qian , Yafei Liu , Canran Xiao , Xinyu Lu , Tingyu Lu , Zhichao Zheng , Yanhui Gu

We present a theory for the construction of out-of-distribution (OOD) detection features for neural networks. We introduce random features for OOD through a novel information-theoretic loss functional consisting of two terms, the first…

Machine Learning · Computer Science 2025-06-18 Sudeepta Mondal , Zhuolin Jiang , Ganesh Sundaramoorthi

Class incremental learning (CIL) aims to learn a model that can not only incrementally accommodate new classes, but also maintain the learned knowledge of old classes. Out-of-distribution (OOD) detection in CIL is to retain this incremental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Wenjun Miao , Guansong Pang , Trong-Tung Nguyen , Ruohang Fang , Jin Zheng , Xiao Bai

In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Harshita Boonlia , Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Ankan Mullick

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

Computation and Language · Computer Science 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

One key challenge in Out-of-Distribution (OOD) detection is the absence of ground-truth OOD samples during training. One principled approach to address this issue is to use samples from external datasets as outliers (i.e., pseudo OOD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenjun Miao , Guansong Pang , Jin Zheng , Xiao Bai

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

Statistical learning relies upon data sampled from a distribution, and we usually do not care what actually generated it in the first place. From the point of view of causal modeling, the structure of each distribution is induced by…

Machine Learning · Computer Science 2018-09-11 Giambattista Parascandolo , Niki Kilbertus , Mateo Rojas-Carulla , Bernhard Schölkopf

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

Machine Learning · Computer Science 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Out-Of-Distribution (OOD) generalization is an essential topic in machine learning. However, recent research is only focusing on the corresponding methods for neural networks. This paper introduces a novel and effective solution for OOD…

Machine Learning · Computer Science 2024-01-19 Yufan Liao , Qi Wu , Xing Yan

Interpretability research often aims to predict how a model will respond to targeted interventions on specific mechanisms. However, it rarely predicts how a model will respond to unseen input data. This paper explores the promises and…

Machine Learning · Computer Science 2025-07-10 Victoria R. Li , Jenny Kaufmann , Martin Wattenberg , David Alvarez-Melis , Naomi Saphra

A powerful concept behind much of the recent progress in machine learning is the extraction of common features across data from heterogeneous sources or tasks. Intuitively, using all of one's data to learn a common representation function…

Machine Learning · Statistics 2024-10-15 Thomas T. C. K. Zhang , Leonardo F. Toso , James Anderson , Nikolai Matni

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Machine learning models often fail to generalize well under distributional shifts. Understanding and overcoming these failures have led to a research field of Out-of-Distribution (OOD) generalization. Despite being extensively studied for…

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

Machine Learning · Computer Science 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

Semantically coherent out-of-distribution detection (SCOOD) is a recently proposed realistic OOD detection setting: given labeled in-distribution (ID) data and mixed in-distribution and out-of-distribution unlabeled data as the training…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhimao Peng , Enguang Wang , Xialei Liu , Ming-Ming Cheng