English
Related papers

Related papers: Implicit Non-Causal Factors are Out via Dataset Sp…

200 papers

Domain adaptation (DA) and domain generalization (DG) have emerged as a solution to the domain shift problem where the distribution of the source and target data is different. The task of DG is more challenging than DA as the target data is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in…

Machine Learning · Statistics 2017-10-31 Dustin Tran , David M. Blei

Conventional domain adaptation algorithms aim to achieve better generalization by aligning only the task-discriminative causal factors between a source and target domain. However, we find that retaining the spurious correlation between…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Sunandini Sanyal , Ashish Ramayee Asokan , Suvaansh Bhambri , Pradyumna YM , Akshay Kulkarni , Jogendra Nath Kundu , R Venkatesh Babu

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

As a useful and efficient alternative to generic model-based control scheme, data-driven predictive control is subject to bias-variance trade-off and is known to not perform desirably in face of uncertainty. Through the connection between…

Optimization and Control · Mathematics 2025-05-26 Malika Sader , Yibo Wang , Dexian Huang , Chao Shang , Biao Huang

Pursuing causality from data is a fundamental problem in scientific discovery, treatment intervention, and transfer learning. This paper introduces a novel algorithmic method for addressing nonparametric invariance and causality learning in…

Statistics Theory · Mathematics 2025-11-18 Yihong Gu , Cong Fang , Peter Bühlmann , Jianqing Fan

Open-world classification systems should discern out-of-distribution (OOD) data whose labels deviate from those of in-distribution (ID) cases, motivating recent studies in OOD detection. Advanced works, despite their promising progress, may…

Machine Learning · Computer Science 2023-12-27 Qizhou Wang , Zhen Fang , Yonggang Zhang , Feng Liu , Yixuan Li , Bo Han

Attention module does not always help deep models learn causal features that are robust in any confounding context, e.g., a foreground object feature is invariant to different backgrounds. This is because the confounders trick the attention…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tan Wang , Chang Zhou , Qianru Sun , Hanwang Zhang

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Domain generalization (DG) aims at generalizing a classifier trained on multiple source domains to an unseen target domain with domain shift. A common pervasive theme in existing DG literature is domain-invariant representation learning…

Machine Learning · Computer Science 2022-10-31 Yujie Jin , Xu Chu , Yasha Wang , Wenwu Zhu

The aim in many sciences is to understand the mechanisms that underlie the observed distribution of variables, starting from a set of initial hypotheses. Causal discovery allows us to infer mechanisms as sets of cause and effect…

Machine Learning · Computer Science 2025-03-05 Ashka Shah , Adela DePavia , Nathaniel Hudson , Ian Foster , Rick Stevens

Recognizing the prevalence of domain shift as a common challenge in machine learning, various domain generalization (DG) techniques have been developed to enhance the performance of machine learning systems when dealing with…

Machine Learning · Computer Science 2024-05-07 Yujie Lin , Chen Zhao , Minglai Shao , Baoluo Meng , Xujiang Zhao , Haifeng Chen

Modern deep learning models excel at pattern recognition but remain fundamentally limited by their reliance on spurious correlations, leading to poor generalization and a demand for massive datasets. We argue that a key ingredient for…

Machine Learning · Computer Science 2025-09-17 Mohamed Zayaan S

In recent years, causal modelling has been used widely to improve generalization and to provide interpretability in machine learning models. To determine cause-effect relationships in the absence of a randomized trial, we can model causal…

Machine Learning · Computer Science 2021-06-03 Rohan Giriraj , Sinnu Susan Thomas

Heterophily is a prevalent property of real-world graphs and is well known to impair the performance of homophilic Graph Neural Networks (GNNs). Prior work has attempted to adapt GNNs to heterophilic graphs through non-local neighbor…

Machine Learning · Computer Science 2026-04-22 Xiangmeng Wang , Qian Li , Haiyang Xia , Hao Miao , Qing Li , Guandong Xu

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

In semi-supervised learning (SSL) for enhancing the performance of graph neural networks (GNNs) with unlabeled data, introducing mutually independent decision factors for cross-validation is regarded as an effective strategy to alleviate…

Machine Learning · Computer Science 2025-08-13 Long Wang , Kai Liu

Deep learning often struggles when training and test data distributions differ. Traditional domain generalization (DG) tackles this by including data from multiple source domains, which is impractical due to expensive data collection and…

Machine Learning · Computer Science 2025-07-15 Lihua Zhou , Mao Ye , Nianxin Li , Shuaifeng Li , Jinlin Wu , Xiatian Zhu , Lei Deng , Hongbin Liu , Jiebo Luo , Zhen Lei

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Fei Su , Aidong Men , Hongying Meng