English
Related papers

Related papers: Out-of-Domain Generalization from a Single Source:…

200 papers

Adapting models to new domain without finetuning is a challenging problem in deep learning. In this paper, we utilize an adversarial training framework for domain generalization in Question Answering (QA) task. Our model consists of a…

Computation and Language · Computer Science 2019-10-23 Seanie Lee , Donggyu Kim , Jangwon Park

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Most real world language problems require learning from heterogenous corpora, raising the problem of learning robust models which generalise well to both similar (in domain) and dissimilar (out of domain) instances to those seen in…

Computation and Language · Computer Science 2018-05-17 Yitong Li , Timothy Baldwin , Trevor Cohn

Developing and deploying machine learning models safely depends on the ability to characterize and compare their abilities to generalize to new environments. Although recent work has proposed a variety of methods that can directly predict…

Machine Learning · Computer Science 2023-07-18 Nathan Ng , Neha Hulkund , Kyunghyun Cho , Marzyeh Ghassemi

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

We tackle the domain generalisation (DG) problem by posing it as a domain adaptation (DA) task where we adversarially synthesise the worst-case target domain and adapt a model to that worst-case domain, thereby improving the model's…

Machine Learning · Computer Science 2023-02-24 Minyoung Kim , Da Li , Timothy Hospedales

Open set domain adaptation refers to the scenario that the target domain contains categories that do not exist in the source domain. It is a more common situation in the reality compared with the typical closed set domain adaptation where…

Machine Learning · Computer Science 2020-11-06 Sitong Mao , Xiao Shen , Fu-lai Chung

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

We propose a novel framework for incorporating unlabeled data into semi-supervised classification problems, where scenarios involving the minimization of either i) adversarially robust or ii) non-robust loss functions have been considered.…

Data collection and annotation are time-consuming in machine learning, expecially for large scale problem. A common approach for this problem is to transfer knowledge from a related labeled domain to a target one. There are two popular ways…

Machine Learning · Computer Science 2020-07-09 Jiawei Wang , Zhaoshui He , Chengjian Feng , Zhouping Zhu , Qinzhuang Lin , Jun Lv , Shengli Xie

Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple diverse training domains,…

Machine Learning · Computer Science 2025-03-11 Hao Yan , Marzi Heidari , Yuhong Guo

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

Domain generalization is proposed to address distribution shift, arising from statistical disparities between training source and unseen target domains. The widely used first-order meta-learning algorithms demonstrate strong performance for…

Machine Learning · Computer Science 2025-03-26 Xiran Wang , Jian Zhang , Lei Qi , Yinghuan Shi