English
Related papers

Related papers: Domain Generalization via Rationale Invariance

200 papers

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee

Learning robust models that generalize well under changes in the data distribution is critical for real-world applications. To this end, there has been a growing surge of interest to learn simultaneously from multiple training domains -…

Machine Learning · Computer Science 2022-06-02 Alexandre Rame , Corentin Dancette , Matthieu Cord

Mainstream state-of-the-art domain generalization algorithms tend to prioritize the assumption on semantic invariance across domains. Meanwhile, the inherent intra-domain style invariance is usually underappreciated and put on the shelf. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Yang Chen , Yu Wang , Yingwei Pan , Ting Yao , Xinmei Tian , Tao Mei

The endeavor to preserve the generalization of a fair and invariant classifier across domains, especially in the presence of distribution shifts, becomes a significant and intricate challenge in machine learning. In response to this…

Machine Learning · Computer Science 2024-05-22 Chen Zhao , Kai Jiang , Xintao Wu , Haoliang Wang , Latifur Khan , Christan Grant , Feng Chen

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Given a causal graph representing the data-generating process shared across different domains/distributions, enforcing sufficient graph-implied conditional independencies can identify domain-general (non-spurious) feature representations.…

Machine Learning · Computer Science 2024-04-26 Olawale Salaudeen , Sanmi Koyejo

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning, which matches and aligns the data distributions on the…

Information Retrieval · Computer Science 2023-11-01 Ruicheng Xian , Honglei Zhuang , Zhen Qin , Hamed Zamani , Jing Lu , Ji Ma , Kai Hui , Han Zhao , Xuanhui Wang , Michael Bendersky

Traditional domain generalization methods often rely on domain alignment to reduce inter-domain distribution differences and learn domain-invariant representations. However, domain shifts are inherently difficult to eliminate, which limits…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuheng Xu , Taiping Zhang

Domain generalization aims to learn an invariant model that can generalize well to the unseen target domain. In this paper, we propose to tackle the problem of domain generalization by delivering an effective framework named Variational…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yufei Wang , Haoliang Li , Hao Cheng , Bihan Wen , Lap-Pui Chau , Alex C. Kot

Domain generalization models aim to learn cross-domain knowledge from source domain data, to improve performance on unknown target domains. Recent research has demonstrated that diverse and rich source domain samples can enhance domain…

Machine Learning · Computer Science 2024-03-12 Jianting Chen , Ling Ding , Yunxiao Yang , Zaiyuan Di , Yang Xiang

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Domain generalization (DG) aims at generalizing a classifier trained on multiple source domains to an unseen target domain with domain shift. A common pervasive theme in existing DG literature is domain-invariant representation learning…

Machine Learning · Computer Science 2022-10-31 Yujie Jin , Xu Chu , Yasha Wang , Wenwu Zhu

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

Despite much progress being made in the field of object recognition with the advances of deep learning, there are still several factors negatively affecting the performance of deep learning models. Domain shift is one of these factors and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Kaiyu Guo , Brian Lovell

Domain generalization asks for models trained over a set of training environments to perform well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) has been proposed for domain…

Machine Learning · Computer Science 2022-07-08 Haoxiang Wang , Haozhe Si , Bo Li , Han Zhao

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Abhimanyu Dubey , Vignesh Ramanathan , Alex Pentland , Dhruv Mahajan

How to effectively leverage the plentiful existing datasets to train a robust and high-performance model is of great significance for many practical applications. However, a model trained on a naive merge of different datasets tends to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Yajie Liu , Pu Ge , Qingjie Liu , Shichao Fan , Yunhong Wang

Developing predictive models that perform reliably across diverse patient populations and heterogeneous environments is a core aim of medical research. However, generalization is only possible if the learned model is robust to statistical…