English
Related papers

Related papers: Mixstyle-Entropy: Domain Generalization with Causa…

200 papers

Robustness audits of deep neural networks (DNN) provide a means to uncover model sensitivities to the challenging real-world imaging conditions that significantly degrade DNN performance in-the-wild. Such conditions are often the result of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Nathan Drenkow , William Paul , Chris Ribaudo , Mathias Unberath

Domain generalization (DG) is proposed to deal with the issue of domain shift, which occurs when statistical differences exist between source and target domains. However, most current methods do not account for a common realistic scenario…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiran Wang , Jian Zhang , Lei Qi , Yinghuan Shi

Domain Generalization (DG) aims to train a model, from multiple observed source domains, in order to perform well on unseen target domains. To obtain the generalization capability, prior DG approaches have focused on extracting…

Machine Learning · Computer Science 2021-10-19 Manh-Ha Bui , Toan Tran , Anh Tuan Tran , Dinh Phung

We study optimal covariate balance for causal inferences from observational data when rich covariates and complex relationships necessitate flexible modeling with neural networks. Standard approaches such as propensity weighting and…

Machine Learning · Statistics 2018-02-16 Nathan Kallus

According to the principle of compositional generalization, the meaning of a complex expression can be understood as a function of the meaning of its parts and of how they are combined. This principle is crucial for human language…

Computation and Language · Computer Science 2024-03-19 Sungjun Han , Sebastian Padó

This paper develops a general causal inference method for treatment effects models with noisily measured confounders. The key feature is that a large set of noisy measurements are linked with the underlying latent confounders through an…

Econometrics · Economics 2021-10-14 Yingjie Feng

Domain Generalization (DG) aims to learn models whose performance remains high on unseen domains encountered at test-time by using data from multiple related source domains. Many existing DG algorithms reduce the divergence between source…

Machine Learning · Computer Science 2022-06-27 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

Distribution shifts between training and testing samples frequently occur in practice and impede model generalization performance. This crucial challenge thereby motivates studies on domain generalization (DG), which aim to predict the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tianxin Wei , Yifan Chen , Xinrui He , Wenxuan Bao , Jingrui He

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Domain generalization (DG) enables generalizing a learning machine from multiple seen source domains to an unseen target one. The general objective of DG methods is to learn semantic representations that are independent of domain labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Chaoqi Chen , Luyao Tang , Feng Liu , Gangming Zhao , Yue Huang , Yizhou Yu

To address distribution shifts between training and test data, domain generalization (DG) leverages multiple source domains to learn a model that generalizes well to unseen domains. However, existing DG methods often overfit to the source…

Machine Learning · Computer Science 2026-04-28 Danni Peng , Sinno Jialin Pan

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Ensembling is now recognized as an effective approach for increasing the predictive performance and calibration of deep networks. We introduce a new approach, Parameter Ensembling by Perturbation (PEP), that constructs an ensemble of…

Machine Learning · Computer Science 2020-10-27 Alireza Mehrtash , Purang Abolmaesumi , Polina Golland , Tina Kapur , Demian Wassermann , William M. Wells

With the rapid development of deep learning methods, there have been many breakthroughs in the field of text classification. Models developed for this task have been shown to achieve high accuracy. However, most of these models are trained…

Machine Learning · Computer Science 2024-09-24 Yuxuan Hu , Chenwei Zhang , Min Yang , Xiaodan Liang , Chengming Li , Xiping Hu

It is well-known that the performance of well-trained deep neural networks may degrade significantly when they are applied to data with even slightly shifted distributions. Recent studies have shown that introducing certain perturbation on…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Yabin Zhang , Bin Deng , Ruihuang Li , Kui Jia , Lei Zhang