English
Related papers

Related papers: Open Set Label Shift with Test Time Out-of-Distrib…

200 papers

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalization. However, the…

Machine Learning · Computer Science 2023-03-28 Junchi Yu , Jian Liang , Ran He

We consider the problem of active domain adaptation (ADA) to unlabeled target data, of which subset is actively selected and labeled given a budget constraint. Inspired by recent analysis on a critical issue from label distribution mismatch…

Machine Learning · Computer Science 2022-08-16 Sehyun Hwang , Sohyun Lee , Sungyeon Kim , Jungseul Ok , Suha Kwak

Multimedia applications are often associated with cross-domain knowledge transfer, where Unsupervised Domain Adaptation (UDA) can be used to reduce the domain shifts. Open Set Domain Adaptation (OSDA) aims to transfer knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Jinghan Ru , Jun Tian , Zhekai Du , Chengwei Xiao , Jingjing Li , Heng Tao Shen

Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown…

Machine Learning · Computer Science 2026-05-28 Fengqiang Wan , Qing-Yuan Jiang , Yang Yang

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

The safe deployment of machine learning and AI models in open-world settings hinges critically on the ability to detect out-of-distribution (OOD) data accurately, data samples that contrast vastly from what the model was trained with.…

Machine Learning · Computer Science 2025-05-23 Andrija Djurisic , Rosanne Liu , Mladen Nikolic

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities and the classifier…

Machine Learning · Computer Science 2023-12-15 Teodora Popordanoska , Gorjan Radevski , Tinne Tuytelaars , Matthew B. Blaschko

Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses…

Machine Learning · Computer Science 2025-05-20 Chuanxing Geng , Qifei Li , Xinrui Wang , Dong Liang , Songcan Chen , Pong C. Yuen

Open-set semi-supervised learning (OSSL) has attracted growing interest, which investigates a more practical scenario where out-of-distribution (OOD) samples are only contained in unlabeled data. Existing OSSL methods like OpenMatch learn…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Haoran Li , Chun-Mei Feng , Tao Zhou , Yong Xu , Xiaojun Chang

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

Open-set semi-supervised learning (open-set SSL) investigates a challenging but practical scenario where out-of-distribution (OOD) samples are contained in the unlabeled data. While the mainstream technique seeks to completely filter out…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Junkai Huang , Chaowei Fang , Weikai Chen , Zhenhua Chai , Xiaolin Wei , Pengxu Wei , Liang Lin , Guanbin Li

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Out-of-distribution (OOD) detection is crucial for model reliability, as it identifies samples from unknown classes and reduces errors due to unexpected inputs. Vision-Language Models (VLMs) such as CLIP are emerging as powerful tools for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yabin Zhang , Wenjie Zhu , Chenhang He , Lei Zhang

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models, so methods of predicting a model's performance on OOD data without labels are important for machine learning safety. While a number of methods have…

Out-of-distribution (OOD) detection methods have recently become more prominent, serving as a core element in safety-critical autonomous systems. One major purpose of OOD detection is to reject invalid inputs that could lead to…

Machine Learning · Computer Science 2025-10-08 Hong Yang , Qi Yu , Travis Desell

Using unlabeled data to regularize the machine learning models has demonstrated promise for improving safety and reliability in detecting out-of-distribution (OOD) data. Harnessing the power of unlabeled in-the-wild data is non-trivial due…

Machine Learning · Computer Science 2024-02-07 Xuefeng Du , Zhen Fang , Ilias Diakonikolas , Yixuan Li

Open-set Semi-supervised Learning (OSSL) holds a realistic setting that unlabeled data may come from classes unseen in the labeled set, i.e., out-of-distribution (OOD) data, which could cause performance degradation in conventional SSL…

Machine Learning · Computer Science 2024-05-21 Yang Yang , Nan Jiang , Yi Xu , De-Chuan Zhan

We present an approach that can be utilized in order to account for the covariate shift between two datasets of the same observable with different distributions. This helps improve the generalizability of a neural network model trained on…

Instrumentation and Methods for Astrophysics · Physics 2025-02-12 Sambatra Andrianomena , Sultan Hassan

In many real-world applications, researchers aim to deploy models trained in a source domain to a target domain, where obtaining labeled data is often expensive, time-consuming, or even infeasible. While most existing literature assumes…

Methodology · Statistics 2025-08-26 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

Out-of-distribution (OOD) detection is crucial for ensuring the reliability and safety of machine learning models in real-world applications. While zero-shot OOD detection, which requires no training on in-distribution (ID) data, has become…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yu Liu , Hao Tang , Haiqi Zhang , Jing Qin , Zechao Li