English
Related papers

Related papers: Interpretations of Domain Adaptations via Layer Va…

200 papers

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

The aim of this paper is to give an overview of domain adaptation and transfer learning with a specific view on visual applications. After a general motivation, we first position domain adaptation in the larger transfer learning problem.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Gabriela Csurka

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Mohammad Javad Shafiee , Parthipan Siva , Paul Fieguth , Alexander Wong

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Domain adaptation aims at training a classifier in one dataset and applying it to a related but not identical dataset. One successfully used framework of domain adaptation is to learn a transformation to match both the distribution of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Xu Zhang , Felix Xinnan Yu , Shih-Fu Chang , Shengjin Wang

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect the success of domain…

Computation and Language · Computer Science 2021-06-25 Nicolai Pogrebnyakov , Shohreh Shaghaghian

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Compared with shallow domain adaptation, recent progress in deep domain adaptation has shown that it can achieve higher predictive performance and stronger capacity to tackle structural data (e.g., image and sequential data). The underlying…

Machine Learning · Computer Science 2019-06-21 Trung Le , Khanh Nguyen , Nhat Ho , Hung Bui , Dinh Phung

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Domain adaptation refers to the process of learning prediction models in a target domain by making use of data from a source domain. Many classic methods solve the domain adaptation problem by establishing a common latent space, which may…

Machine Learning · Computer Science 2018-08-21 Pan Xiao , Bo Du , Jia Wu , Lefei Zhang , Ruimin Hu , Xuelong Li

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci
‹ Prev 1 2 3 10 Next ›