English
Related papers

Related papers: Proxy Methods for Domain Adaptation

200 papers

Transfer learning is known to perform efficiently in many applications empirically, yet limited literature reports the mechanism behind the scene. This study establishes both formal derivations and heuristic analysis to formulate the theory…

Machine Learning · Computer Science 2023-05-10 Huan-Hsin Tseng , Hsin-Yi Lin , Kuo-Hsuan Hung , Yu Tsao

In real-world visual recognition problems, the assumption that the training data (source domain) and test data (target domain) are sampled from the same distribution is often violated. This is known as the domain adaptation problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Hongyu Xu , Jingjing Zheng , Azadeh Alavi , Rama Chellappa

This thesis contributes to the mathematical foundation of domain adaptation as emerging field in machine learning. In contrast to classical statistical learning, the framework of domain adaptation takes into account deviations between…

Machine Learning · Statistics 2020-04-23 Werner Zellinger

Unsupervised domain adaptation aims at transferring knowledge from the labeled source domain to the unlabeled target domain. Previous adversarial domain adaptation methods mostly adopt the discriminator with binary or $K$-dimensional output…

Machine Learning · Computer Science 2020-01-03 Yuntao Du , Zhiwen Tan , Qian Chen , Xiaowen Zhang , Yirong Yao , Chongjun Wang

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we…

Machine Learning · Computer Science 2021-07-26 Xiaofeng Liu , Bo Hu , Linghao Jin , Xu Han , Fangxu Xing , Jinsong Ouyang , Jun Lu , Georges EL Fakhri , Jonghye Woo

Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampling variability, class imbalance, and data-privacy concerns…

Machine Learning · Computer Science 2021-10-26 Korawat Tanwisuth , Xinjie Fan , Huangjie Zheng , Shujian Zhang , Hao Zhang , Bo Chen , Mingyuan Zhou

We present a theoretical and algorithmic study of the multiple-source domain adaptation problem in the common scenario where the learner has access only to a limited amount of labeled target data, but where the learner has at disposal a…

Machine Learning · Computer Science 2020-11-02 Yishay Mansour , Mehryar Mohri , Jae Ro , Ananda Theertha Suresh , Ke Wu

Domain adaptation aims to leverage a label-rich domain (the source domain) to help model learning in a label-scarce domain (the target domain). Most domain adaptation methods require the co-existence of source and target domain samples to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jiayi Tian , Jing Zhang , Wen Li , Dong Xu

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Recent years have witnessed tremendous interest in deep learning on graph-structured data. Due to the high cost of collecting labeled graph-structured data, domain adaptation is important to supervised graph learning tasks with limited…

Machine Learning · Computer Science 2021-06-15 Ruichu Cai , Fengzhu Wu , Zijian Li , Pengfei Wei , Lingling Yi , Kun Zhang

In practical machine learning settings, the data on which a model must make predictions often come from a different distribution than the data it was trained on. Here, we investigate the problem of unsupervised multi-source domain…

Machine Learning · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

Domain generalization (DG) aims to learn from multiple source domains a model that can generalize well on unseen target domains. Existing DG methods mainly learn the representations with invariant marginal distribution of the input…

Machine Learning · Computer Science 2023-05-26 Junkun Yuan , Xu Ma , Ruoxuan Xiong , Mingming Gong , Xiangyu Liu , Fei Wu , Lanfen Lin , Kun Kuang

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

We propose a method to infer domain-specific models such as classifiers for unseen domains, from which no data are given in the training phase, without domain semantic descriptors. When training and test distributions are different,…

Machine Learning · Statistics 2018-07-10 Atsutoshi Kumagai , Tomoharu Iwata

Recent unsupervised domain adaptation methods have utilized vicinal space between the source and target domains. However, the equilibrium collapse of labels, a problem where the source labels are dominant over the target labels in the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jaemin Na , Dongyoon Han , Hyung Jin Chang , Wonjun Hwang

Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Hui Tang , Yaowei Wang , Kui Jia

We present a novel instance-based approach to handle regression tasks in the context of supervised domain adaptation under an assumption of covariate shift. The approach developed in this paper is based on the assumption that the task on…

Machine Learning · Computer Science 2021-09-16 Antoine de Mathelin , Guillaume Richard , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, we propose…

Machine Learning · Computer Science 2021-06-21 Yabin Zhang , Bin Deng , Kui Jia , Lei Zhang

We propose to meta-learn causal structures based on how fast a learner adapts to new distributions arising from sparse distributional changes, e.g. due to interventions, actions of agents and other sources of non-stationarities. We show…

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten