English
Related papers

Related papers: Causal invariant geographic network representation…

200 papers

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Trajectory prediction is critical for autonomous driving vehicles. Most existing methods tend to model the correlation between history trajectory (input) and future trajectory (output). Since correlation is just a superficial description of…

Machine Learning · Computer Science 2023-07-13 Shengyi Li , Qifan Xue , Yezhuo Zhang , Xuanpeng Li

Out-of-distribution (OOD) generalisation is considered a hallmark of human and animal intelligence. To achieve OOD through composition, a system must discover the environment-invariant properties of experienced input-output mappings and…

Machine Learning · Computer Science 2025-05-19 George Dimitriadis , Spyridon Samothrakis

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

Machine Learning · Computer Science 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this…

Machine Learning · Computer Science 2025-01-03 Zhaobin Mo , Haotian Xiang , Xuan Di

Recent advances in deep learning architectures have enabled efficient and accurate classification of pre-trained targets in Synthetic Aperture Radar (SAR) images. Nevertheless, the presence of unknown targets in real battlefield scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Kyung-hwan Lee , Kyung-tae Kim

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Recent studies show that even highly biased dense networks contain an unbiased substructure that can achieve better out-of-distribution (OOD) generalization than the original model. Existing works usually search the invariant subnetwork…

Machine Learning · Computer Science 2022-12-20 Yingchun Wang , Jingcai Guo , Song Guo , Weizhan Zhang , Jie Zhang

Unsupervised out-of-distribution (OOD) detection aims to identify out-of-domain data by learning only from unlabeled In-Distribution (ID) training samples, which is crucial for developing a safe real-world machine learning system. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ying Yang , De Cheng , Chaowei Fang , Yubiao Wang , Changzhe Jiao , Lechao Cheng , Nannan Wang

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

Machine Learning · Computer Science 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Wolfgang M. Pernice , Michael Doron , Alex Quach , Aditya Pratapa , Sultan Kenjeyev , Nicholas De Veaux , Michio Hirano , Juan C. Caicedo

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, but its performance can degrade when fine-tuned in out-of-distribution (OOD) scenarios. We model the prediction process using a Structural Causal Model (SCM) and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Zeen Song , Siyu Zhao , Xingyu Zhang , Jiangmeng Li , Changwen Zheng , Wenwen Qiang

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Systematics contaminate observables, leading to distribution shifts relative to theoretically simulated signals-posing a major challenge for using pre-trained models to label such observables. Since systematics are often poorly understood…

Instrumentation and Methods for Astrophysics · Physics 2025-11-18 Sultan Hassan , Sambatra Andrianomena , Benjamin D. Wandelt

Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jinlun Ye , Zhuohao Sun , Yiqiao Qiu , Qiu Li , Zhijun Tan , Ruixuan Wang

Molecular representation learning lays the foundation for drug discovery. However, existing methods suffer from poor out-of-distribution (OOD) generalization, particularly when data for training and testing originate from different…

Machine Learning · Computer Science 2023-10-24 Xiang Zhuang , Qiang Zhang , Keyan Ding , Yatao Bian , Xiao Wang , Jingsong Lv , Hongyang Chen , Huajun Chen

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

Machine Learning · Computer Science 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Despite impressive performance as evaluated on i.i.d. holdout data, deep neural networks depend heavily on superficial statistics of the training data and are liable to break under distribution shift. For example, subtle changes to the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Haohan Wang , Zexue He , Zachary C. Lipton , Eric P. Xing

Out-of-distribution generalization is a common problem that expects the model to perform well in the different distributions even far from the train data. A popular approach to addressing this issue is invariant learning (IL), in which the…

Machine Learning · Computer Science 2025-05-23 Jiaqi Wang , Yuhang Zhou , Zhixiong Zhang , Qiguang Chen , Yongqiang Chen , James Cheng