English
Related papers

Related papers: A General Upper Bound for Unsupervised Domain Adap…

200 papers

Domain adaptation deals with adapting classifiers trained on data from a source distribution, to work effectively on data from a target distribution. In this paper, we introduce the Nonlinear Embedding Transform (NET) for unsupervised…

Artificial Intelligence · Computer Science 2017-06-26 Hemanth Venkateswara , Shayok Chakraborty , Troy McDaniel , Sethuraman Panchanathan

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

We provide two main contributions in PAC-Bayesian theory for domain adaptation where the objective is to learn, from a source distribution, a well-performing majority vote on a different, but related, target distribution. Firstly, we…

Machine Learning · Statistics 2019-11-19 Pascal Germain , Amaury Habrard , François Laviolette , Emilie Morvant

Learning domain-invariant representations has become a popular approach to unsupervised domain adaptation and is often justified by invoking a particular suite of theoretical results. We argue that there are two significant flaws in such…

Machine Learning · Statistics 2019-07-05 Fredrik D. Johansson , David Sontag , Rajesh Ranganath

In recent years, deep neural networks have emerged as a dominant machine learning tool for a wide variety of application domains. However, training a deep neural network requires a large amount of labeled data, which is an expensive process…

Computer Vision and Pattern Recognition · Computer Science 2017-06-26 Hemanth Venkateswara , Jose Eusebio , Shayok Chakraborty , Sethuraman Panchanathan

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by…

Machine Learning · Computer Science 2023-12-04 Yishay Mansour , Mehryar Mohri , Afshin Rostamizadeh

Unsupervised Domain Adaptation (UDA) refers to the problem of learning a model in a target domain where labeled data are not available by leveraging information from annotated data in a source domain. Most deep UDA approaches operate in a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

A classifier trained on a dataset seldom works on other datasets obtained under different conditions due to domain shift. This problem is commonly addressed by domain adaptation methods. In this work we introduce a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Subhankar Roy , Aliaksandr Siarohin , Enver Sangineto , Samuel Rota Bulo , Nicu Sebe , Elisa Ricci

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

Unsupervised Domain Adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain in the presence of dataset shift. Most existing methods cannot address the domain alignment and class…

Machine Learning · Computer Science 2021-12-22 You-Wei Luo , Chuan-Xian Ren , Zi-Ying Chen

Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models. Existing methods…

Machine Learning · Computer Science 2023-06-01 Maohao Shen , Yuheng Bu , Gregory Wornell

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

Recent advances in unsupervised learning have shown that unsupervised pre-training, followed by fine-tuning, can improve model generalization. However, a rigorous understanding of how the representation function learned on an unlabeled…

Machine Learning · Computer Science 2024-03-12 Yuyang Deng , Junyuan Hong , Jiayu Zhou , Mehrdad Mahdavi

This paper presents an unsupervised domain adaptation (UDA) method for predicting unlabeled target domain data, specific to complex UDA tasks where the domain gap is significant. Mainstream UDA models aim to learn from both domains and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jun Kataoka , Hyunsoo Yoon

Unsupervised domain adaptation aims to learn a model of classifier for unlabeled samples on the target domain, given training data of labeled samples on the source domain. Impressive progress is made recently by learning invariant features…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Yabin Zhang , Hui Tang , Kui Jia , Mingkui Tan

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Transfer learning has emerged as a powerful technique for improving the performance of machine learning models on new domains where labeled training data may be scarce. In this approach a model trained for a source task, where plenty of…

Machine Learning · Computer Science 2020-06-19 Seyed Mohammadreza Mousavi Kalan , Zalan Fabian , A. Salman Avestimehr , Mahdi Soltanolkotabi