English
Related papers

Related papers: Residual Parameter Transfer for Deep Domain Adapta…

200 papers

In this paper, we consider domain-invariant deep learning by explicitly modeling domain shifts with only a small amount of domain-specific parameters in a Convolutional Neural Network (CNN). By exploiting the observation that a…

Machine Learning · Computer Science 2020-09-30 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks for domain adaptation. However, as deep features eventually transition from general to specific along the network, the…

Machine Learning · Computer Science 2015-05-28 Mingsheng Long , Yue Cao , Jianmin Wang , Michael I. Jordan

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

Deep learning approaches are highly specialized and require training separate models for different tasks. Multi-domain learning looks at ways to learn a multitude of different tasks, each coming from a different domain, at once. The most…

Machine Learning · Computer Science 2020-03-26 Ali Senhaji , Jenni Raitoharju , Moncef Gabbouj , Alexandros Iosifidis

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Deep models must learn robust and transferable representations in order to perform well on new domains. While domain transfer methods (e.g., domain adaptation, domain generalization) have been proposed to learn transferable representations…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Donghyun Kim , Kaihong Wang , Stan Sclaroff , Kate Saenko

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

Current state-of-the-art visual recognition systems usually rely on the following pipeline: (a) pretraining a neural network on a large-scale dataset (e.g., ImageNet) and (b) finetuning the network weights on a smaller, task-specific…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Guangrun Wang , Liang Lin , Rongcong Chen , Guangcong Wang , Jiqi Zhang

Deep domain adaptation methods have achieved appealing performance by learning transferable representations from a well-labeled source domain to a different but related unlabeled target domain. Most existing works assume source and target…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Shuang Li , Chi Harold Liu , Qiuxia Lin , Qi Wen , Limin Su , Gao Huang , Zhengming Ding

Transfer learning is known to perform efficiently in many applications empirically, yet limited literature reports the mechanism behind the scene. This study establishes both formal derivations and heuristic analysis to formulate the theory…

Machine Learning · Computer Science 2023-05-10 Huan-Hsin Tseng , Hsin-Yi Lin , Kuo-Hsuan Hung , Yu Tsao

End-to-end learning methods have achieved impressive results in many areas of computer vision. At the same time, these methods still suffer from a degradation in performance when testing on new datasets that stem from a different…

Computer Vision and Pattern Recognition · Computer Science 2016-03-24 Rahaf Aljundi , Tinne Tuytelaars

Domain adaptation aims to leverage knowledge from a well-labeled source domain to a poorly-labeled target domain. A majority of existing works transfer the knowledge at either feature level or sample level. Recent researches reveal that…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Li Jingjing , Jing Mengmeng , Lu Ke , Zhu Lei , Shen Heng Tao

In this paper, we introduce a novel concept for learning of the parameters in a neural network. Our idea is grounded on modeling a learning problem that addresses a trade-off between (i) satisfying local objectives at each node and (ii)…

Machine Learning · Computer Science 2019-02-04 Dimche Kostadinov , Behrooz Razdehi , Slava Voloshynovskiy

Adversarial learning has been embedded into deep networks to learn disentangled and transferable representations for domain adaptation. Existing adversarial domain adaptation methods may not effectively align different domains of multimodal…

Machine Learning · Computer Science 2019-01-01 Mingsheng Long , Zhangjie Cao , Jianmin Wang , Michael I. Jordan

Recent works on domain adaptation reveal the effectiveness of adversarial learning on filling the discrepancy between source and target domains. However, two common limitations exist in current adversarial-learning-based methods. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Minghao Xu , Jian Zhang , Bingbing Ni , Teng Li , Chengjie Wang , Qi Tian , Wenjun Zhang

Domain adaptation (DA) aims at improving the performance of a model on target domains by transferring the knowledge contained in different but related source domains. With recent advances in deep learning models which are extremely data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Gabriela Csurka

Cross-domain recommendation has long been one of the major topics in recommender systems. Recently, various deep models have been proposed to transfer the learned knowledge across domains, but most of them focus on extracting abstract…

Machine Learning · Computer Science 2019-05-28 Feng Yuan , Lina Yao , Boualem Benatallah

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din