English
Related papers

Related papers: Improving Domain Generalization with Domain Relati…

200 papers

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

In Domain Generalization (DG) tasks, models are trained by using only training data from the source domains to achieve generalization on an unseen target domain, this will suffer from the distribution shift problem. So it's important to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Cheng Dai , Yingqiao Lin , Fan Li , Xiyao Li , Donglin Xie

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

Machine Learning · Computer Science 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee

In AI-based histopathology, domain shifts are common and well-studied. However, this research focuses on stain and scanner variations, which do not show the full picture -- shifts may be combinations of other shifts, or "invisible" shifts…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Andrew Walker

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

The phenomenon of distribution shift (DS) occurs when a dataset at test time differs from the dataset at training time, which can significantly impair the performance of a machine learning model in practical settings due to a lack of…

Domain generalization (DG) is a branch of transfer learning that aims to train the learning models on several seen domains and subsequently apply these pre-trained models to other unseen (unknown but related) domains. To deal with…

Machine Learning · Computer Science 2022-10-28 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

The generalization capability of machine learning models, which refers to generalizing the knowledge for an "unseen" domain via learning from one or multiple seen domain(s), is of great importance to develop and deploy machine learning…

Machine Learning · Computer Science 2022-02-17 Keyu Chen , Di Zhuang , J. Morris Chang