English
Related papers

Related papers: Domain Generalisation via Risk Distribution Matchi…

200 papers

In real-world applications, a machine learning model is required to handle an open-set recognition (OSR), where unknown classes appear during the inference, in addition to a domain shift, where the distribution of data differs between the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Masashi Noguchi , Shinichi Shirakawa

Machine learning systems typically assume that the distributions of training and test sets match closely. However, a critical requirement of such systems in the real world is their ability to generalize to unseen domains. Here, we propose…

Machine Learning · Computer Science 2021-07-15 Yuge Shi , Jeffrey Seely , Philip H. S. Torr , N. Siddharth , Awni Hannun , Nicolas Usunier , Gabriel Synnaeve

Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which…

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Prithvijit Chattopadhyay , Yogesh Balaji , Judy Hoffman

Covariate shifts are a common problem in predictive modeling on real-world problems. This paper proposes addressing the covariate shift problem by minimizing Maximum Mean Discrepancy (MMD) statistics between the training and test sets in…

Machine Learning · Computer Science 2022-03-03 Liwen Ouyang , Aaron Key

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li

Multimodal Domain Generalization (MMDG) leverages the complementary strengths of multiple modalities to enhance model generalization on unseen domains. A central challenge in multimodal learning is optimization imbalance, where modalities…

Machine Learning · Computer Science 2026-03-17 Hongzhao Li , Guohao Shen , Shupan Li , Mingliang Xu , Muhammad Haris Khan

As training datasets grow larger, we aspire to develop models that generalize well to any diverse test distribution, even if the latter deviates significantly from the training data. Various approaches like domain adaptation, domain…

Machine Learning · Computer Science 2024-10-10 Andreas Loukas , Karolis Martinkus , Ed Wagstaff , Kyunghyun Cho

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

Distribution alignment has many applications in deep learning, including domain adaptation and unsupervised image-to-image translation. Most prior work on unsupervised distribution alignment relies either on minimizing simple non-parametric…

Machine Learning · Computer Science 2020-10-27 Ben Usman , Avneesh Sud , Nick Dufour , Kate Saenko

Distribution matching (DM) is a versatile domain-invariant representation learning technique that has been applied to tasks such as fair classification, domain adaptation, and domain translation. Non-parametric DM methods struggle with…

Machine Learning · Computer Science 2025-06-18 Ziyu Gong , Jim Lim , David I. Inouye

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

Domain adaptation aims to generalise a high-performance learner on target domain (non-labelled data) by leveraging the knowledge from source domain (rich labelled data) which comes from a different but related distribution. Assuming the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Jie Su

Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is establishing a metric…

Machine Learning · Computer Science 2020-07-21 Rongzhe Wei , Fa Zhang , Bo Dong , Qinghua Zheng

Domain generalization (DG) is a prevalent problem in real-world applications, which aims to train well-generalized models for unseen target domains by utilizing several source domains. Since domain labels, i.e., which domain each data point…

Machine Learning · Computer Science 2023-11-14 Yunze Tong , Junkun Yuan , Min Zhang , Didi Zhu , Keli Zhang , Fei Wu , Kun Kuang

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Abhimanyu Dubey , Vignesh Ramanathan , Alex Pentland , Dhruv Mahajan

A desirable property of any deployed artificial intelligence is generalization across domains, i.e. data generation distribution under a specific acquisition condition. In medical imagining applications the most coveted property for…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Ayan Banerjee , Komandoor Srivathsan , Sandeep K. S. Gupta

Domain generalization asks for models trained over a set of training environments to perform well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) has been proposed for domain…

Machine Learning · Computer Science 2022-07-08 Haoxiang Wang , Haozhe Si , Bo Li , Han Zhao

Domain generalization (DG) enables generalizing a learning machine from multiple seen source domains to an unseen target one. The general objective of DG methods is to learn semantic representations that are independent of domain labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Chaoqi Chen , Luyao Tang , Feng Liu , Gangming Zhao , Yue Huang , Yizhou Yu

The goal of domain generalization (DG) is to enhance the generalization capability of the model learned from a source domain to other unseen domains. The recently developed Sharpness-Aware Minimization (SAM) method aims to achieve this goal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Pengfei Wang , Zhaoxiang Zhang , Zhen Lei , Lei Zhang