English
Related papers

Related papers: Causal-Driven Feature Evaluation for Cross-Domain …

200 papers

Most approaches to out-of-distribution (OOD) generalization learn domain-invariant representations by discarding contextual bias. In this paper, we raise a critical question: Should bias be eliminated? If not, is there a general way to…

Machine Learning · Computer Science 2026-02-06 Yan Li , Yunlong Deng , Zijian Li , Anpeng Wu , Zeyu Tang , Kun Zhang , Guangyi Chen

Out-of-domain (OOD) generalization is a significant challenge for machine learning models. Many techniques have been proposed to overcome this challenge, often focused on learning models with certain invariance properties. In this work, we…

Machine Learning · Computer Science 2022-01-13 Yoav Wald , Amir Feder , Daniel Greenfeld , Uri Shalit

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qiaowei Miao , Yawei Luo , Yi Yang

Machine learning methods can be unreliable when deployed in domains that differ from the domains on which they were trained. There are a wide range of proposals for mitigating this problem by learning representations that are ``invariant''…

Machine Learning · Statistics 2023-02-09 Zihao Wang , Victor Veitch

In the realm of stock prediction, machine learning models encounter considerable obstacles due to the inherent low signal-to-noise ratio and the nonstationary nature of financial markets. These challenges often result in spurious…

Portfolio Management · Quantitative Finance 2025-03-28 Songci Xu , Qiangqiang Cheng , Chi-Guhn Lee

Trajectory prediction is critical for autonomous driving vehicles. Most existing methods tend to model the correlation between history trajectory (input) and future trajectory (output). Since correlation is just a superficial description of…

Machine Learning · Computer Science 2023-07-13 Shengyi Li , Qifan Xue , Yezhuo Zhang , Xuanpeng Li

Unsupervised approaches for learning representations invariant to common transformations are used quite often for object recognition. Learning invariances makes models more robust and practical to use in real-world scenarios. Since data…

Machine Learning · Computer Science 2024-02-27 Gauri Gupta , Ritvik Kapila , Keshav Gupta , Ramesh Raskar

The primary goal of out-of-distribution (OOD) detection tasks is to identify inputs with semantic shifts, i.e., if samples from novel classes are absent in the in-distribution (ID) dataset used for training, we should reject these OOD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

Machine Learning · Computer Science 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia

The ability of an agent to do well in new environments is a critical aspect of intelligence. In machine learning, this ability is known as $\textit{strong}$ or $\textit{out-of-distribution}$ generalization. However, merely considering…

Machine Learning · Computer Science 2024-02-09 Siyuan Guo , Jonas Wildberger , Bernhard Schölkopf

Image captioning research achieved breakthroughs in recent years by developing neural models that can generate diverse and high-quality descriptions for images drawn from the same distribution as training images. However, when facing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Gabi Shalev , Gal-Lev Shalev , Joseph Keshet

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

Detecting Out-of-Distribution (OOD) sensory data and covariate distribution shift aims to identify new test examples with different high-level image statistics to the captured, normal and In-Distribution (ID) set. Existing OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Christiaan Viviers , Amaan Valiuddin , Francisco Caetano , Lemar Abdi , Lena Filatova , Peter de With , Fons van der Sommen

Out-of-distribution (OOD) generalization is a complicated problem due to the idiosyncrasies of possible distribution shifts between training and test domains. Most benchmarks employ diverse datasets to address this issue; however, the…

Machine Learning · Computer Science 2023-12-18 Kaican Li , Yifan Zhang , Lanqing Hong , Zhenguo Li , Nevin L. Zhang

A majority of recent work in AI assesses models' generalization capabilities through the lens of performance on out-of-distribution (OOD) datasets. Despite their practicality, such evaluations build upon a strong assumption: that OOD…

Computation and Language · Computer Science 2025-08-27 Michal Štefánik , Timothee Mickus , Marek Kadlčík , Michal Spiegel , Josef Kuchař

We consider the task of out-of-distribution (OOD) generalization, where the distribution shift is due to an unobserved confounder ($Z$) affecting both the covariates ($X$) and the labels ($Y$). This confounding introduces heterogeneity in…

Machine Learning · Computer Science 2025-08-14 Parjanya Prashant , Seyedeh Baharan Khatami , Bruno Ribeiro , Babak Salimi

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Prior work typically describes out-of-domain (OOD) or out-of-distribution (OODist) samples as those that originate from dataset(s) or source(s) different from the training set but for the same task. When compared to in-domain (ID) samples,…

Computation and Language · Computer Science 2023-06-05 Rhitabrat Pokharel , Ameeta Agrawal

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu