English
Related papers

Related papers: Gradual Domain Adaptation via Normalizing Flows

200 papers

In this paper, we propose a novel domain adaptation method for the source-free setting. In this setting, we cannot access source data during adaptation, while unlabeled target data and a model pretrained with source data are given. Due to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Masato Ishii , Masashi Sugiyama

We propose a simple domain adaptation method for neural networks in a supervised setting. Supervised domain adaptation is a way of improving the generalization performance on the target domain by using the source domain dataset, assuming…

Computation and Language · Computer Science 2016-07-05 Yusuke Watanabe , Kazuma Hashimoto , Yoshimasa Tsuruoka

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the labeled source data.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Jogendra Nath Kundu , Akshay Kulkarni , Suvaansh Bhambri , Deepesh Mehta , Shreyas Kulkarni , Varun Jampani , R. Venkatesh Babu

Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source…

We develop an algorithm to improve the performance of a pre-trained model under concept shift without retraining the model from scratch when only unannotated samples of initial concepts are accessible. We model this problem as a domain…

Machine Learning · Computer Science 2022-11-22 Mohammad Rostami , Aram Galstyan

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Compared with shallow domain adaptation, recent progress in deep domain adaptation has shown that it can achieve higher predictive performance and stronger capacity to tackle structural data (e.g., image and sequential data). The underlying…

Machine Learning · Computer Science 2019-06-21 Trung Le , Khanh Nguyen , Nhat Ho , Hung Bui , Dinh Phung

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, the poor ability of adapting to dynamic environments remains a major challenge for AI models. To better understand this issue, we study the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Peng Su , Shixiang Tang , Peng Gao , Di Qiu , Ni Zhao , Xiaogang Wang

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

Machine Learning · Computer Science 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple…

Machine Learning · Computer Science 2020-07-22 Seonguk Seo , Yumin Suh , Dongwan Kim , Geeho Kim , Jongwoo Han , Bohyung Han

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks…

Machine Learning · Computer Science 2019-06-11 Woong-Gi Chang , Tackgeun You , Seonguk Seo , Suha Kwak , Bohyung Han

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

Machine Learning · Computer Science 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain. Hence, a crucial aspect is to properly combine different sources based on their relations. In this paper, we…

Machine Learning · Computer Science 2021-06-16 Changjian Shui , Zijian Li , Jiaqi Li , Christian Gagné , Charles Ling , Boyu Wang

Domain Adaptation is an actively researched problem in Computer Vision. In this work, we propose an approach that leverages unsupervised data to bring the source and target distributions closer in a learned joint feature space. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Swami Sankaranarayanan , Yogesh Balaji , Carlos D. Castillo , Rama Chellappa