English
Related papers

Related papers: Gated Domain Units for Multi-source Domain General…

200 papers

Robustness in Natural Language Processing continues to be a pertinent issue, where state of the art models under-perform under naturally shifted distributions. In the context of Question Answering, work on domain adaptation methods…

Computation and Language · Computer Science 2024-02-12 Arijit Ghosh Chowdhury , Aman Chadha

Despite the striking performance achieved by modern detectors when training and test data are sampled from the same or similar distribution, the generalization ability of detectors under unknown distribution shifts remains hardly studied.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Xingxuan Zhang , Zekai Xu , Renzhe Xu , Jiashuo Liu , Peng Cui , Weitao Wan , Chong Sun , Chen Li

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

Domain Generalization techniques aim to enhance model robustness by simulating novel data distributions during training, typically through various augmentation or stylization strategies. However, these methods frequently suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo Adolfo Vargas Hakim , David Osowiechi , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change…

Machine Learning · Computer Science 2020-10-26 Kun Zhang , Mingming Gong , Petar Stojanov , Biwei Huang , Qingsong Liu , Clark Glymour

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Domain generalization (DG) is a fundamental yet very challenging research topic in machine learning. The existing arts mainly focus on learning domain-invariant features with limited source domains in a static model. Unfortunately, there is…

Machine Learning · Computer Science 2022-05-30 Zhishu Sun , Zhifeng Shen , Luojun Lin , Yuanlong Yu , Zhifeng Yang , Shicai Yang , Weijie Chen

Unsupervised Domain Adaptation (UDA) is quite challenging due to the large distribution discrepancy between the source domain and the target domain. Inspired by diffusion models which have strong capability to gradually convert data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Duo Peng , Qiuhong Ke , Yinjie Lei , Jun Liu

Machine learning models are intrinsically vulnerable to domain shift between training and testing data, resulting in poor performance in novel domains. Domain generalization (DG) aims to overcome the problem by leveraging multiple source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Tingwei Wang , Da Li , Kaiyang Zhou , Tao Xiang , Yi-Zhe Song

The need to address the scarcity of task-specific annotated data has resulted in concerted efforts in recent years for specific settings such as zero-shot learning (ZSL) and domain generalization (DG), to separately address the issues of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shivam Chandhok , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Vineeth N Balasubramanian , Fahad Shahbaz Khan , Ling Shao

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Machine learning systems may encounter unexpected problems when the data distribution changes in the deployment environment. A major reason is that certain combinations of domains and labels are not observed during training but appear in…

Machine Learning · Computer Science 2022-08-04 Yivan Zhang , Jindong Wang , Xing Xie , Masashi Sugiyama

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Domain generalization is challenging due to the domain shift and the uncertainty caused by the inaccessibility of target domain data. In this paper, we address both challenges with a probabilistic framework based on variational Bayesian…

Machine Learning · Computer Science 2021-07-16 Zehao Xiao , Jiayi Shen , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

Domain generalization aims to apply knowledge gained from multiple labeled source domains to unseen target domains. The main difficulty comes from the dataset bias: training data and test data have different distributions, and the training…

Machine Learning · Computer Science 2018-07-24 Ya Li , Mingming Gong , Xinmei Tian , Tongliang Liu , Dacheng Tao