English
Related papers

Related papers: Breaking Correlation Shift via Conditional Invaria…

200 papers

Generalization to out-of-distribution (OOD) data is a critical challenge in machine learning. Ensemble-based methods, like weight space ensembles that interpolate model parameters, have been shown to achieve superior OOD performance.…

Machine Learning · Computer Science 2024-07-16 Yong Lin , Lu Tan , Yifan Hao , Honam Wong , Hanze Dong , Weizhong Zhang , Yujiu Yang , Tong Zhang

Despite agreement on the importance of detecting out-of-distribution (OOD) examples, there is little consensus on the formal definition of OOD examples and how to best detect them. We categorize these examples by whether they exhibit a…

Computation and Language · Computer Science 2021-12-16 Udit Arora , William Huang , He He

Recent empirical studies on domain generalization (DG) have shown that DG algorithms that perform well on some distribution shifts fail on others, and no state-of-the-art DG algorithm performs consistently well on all shifts. Moreover,…

Machine Learning · Computer Science 2024-05-21 Jivat Neet Kaur , Emre Kiciman , Amit Sharma

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

Machine Learning · Computer Science 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

This paper proposes deception as a mechanism for out-of-distribution (OOD) generalization: by learning data representations that make training data appear independent and identically distributed (iid) to an observer, we can identify stable…

Machine Learning · Computer Science 2025-09-16 Anirudha Majumdar

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. However, this assumption often fails in the presence of…

Machine Learning · Computer Science 2025-04-03 Chu Zhao , Enneng Yang , Yuliang Liang , Pengxiang Lan , Yuting Liu , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Machine learning can benefit from causal discovery for interpretation and from causal inference for generalization. In this line of research, a few invariant learning algorithms for out-of-distribution (OOD) generalization have been…

Machine Learning · Computer Science 2023-04-06 Borja Guerrero Santillan

OOD-CV challenge is an out-of-distribution generalization task. In this challenge, our core solution can be summarized as that Noisy Label Learning Is A Strong Test-Time Domain Adaptation Optimizer. Briefly speaking, our main pipeline can…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Yilu Guo , Xingyue Shi , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

We study the problem of efficiently detecting Out-of-Distribution (OOD) samples at test time in supervised and unsupervised learning contexts. While ML models are typically trained under the assumption that training and test data stem from…

Machine Learning · Computer Science 2024-05-13 Alberto Caron , Chris Hicks , Vasilios Mavroudis

Machine learning society has witnessed the emergence of a myriad of Out-of-Distribution (OoD) algorithms, which address the distribution shift between the training and the testing distribution by searching for a unified predictor or…

Machine Learning · Computer Science 2023-06-16 Runpeng Yu , Songhua Liu , Xingyi Yang , Xinchao Wang

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

This work tackles a central machine learning problem of performance degradation on out-of-distribution (OOD) test sets. The problem is particularly salient in medical imaging based diagnosis system that appears to be accurate but fails when…

Image and Video Processing · Electrical Eng. & Systems 2022-09-12 Xin Li , Yao Qiang , Chengyin Li , Sijia Liu , Dongxiao Zhu

Graph machine learning has been extensively studied in both academia and industry. Although booming with a vast number of emerging methods and techniques, most of the literature is built on the in-distribution hypothesis, i.e., testing and…

Machine Learning · Computer Science 2023-01-02 Haoyang Li , Xin Wang , Ziwei Zhang , Wenwu Zhu

An open scientific challenge is how to classify events with reliable measures of uncertainty, when we have a mechanistic model of the data-generating process but the distribution over both labels and latent nuisance parameters is different…

Machine Learning · Statistics 2024-07-02 Luca Masserano , Alex Shen , Michele Doro , Tommaso Dorigo , Rafael Izbicki , Ann B. Lee

Unsupervised Domain Adaptive Object Detection (UDA-OD) uses unlabelled data to improve the reliability of robotic vision systems in open-world environments. Previous approaches to UDA-OD based on self-training have been effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Christopher Lehnert

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

Machine Learning · Computer Science 2023-01-18 Dongsung Huh , Avinash Baidya

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

Machine Learning · Computer Science 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

Machine Learning · Computer Science 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Out-of-distribution (OOD) detection plays a key role in enhancing the robustness of artificial intelligence systems by identifying inputs that differ significantly from the training distribution, thereby preventing unreliable predictions…