English
Related papers

Related papers: Residual Parameter Transfer for Deep Domain Adapta…

200 papers

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Mohammad Javad Shafiee , Parthipan Siva , Paul Fieguth , Alexander Wong

In this paper, we propose a dual-module network architecture that employs a domain discriminative feature module to encourage the domain invariant feature module to learn more domain invariant features. The proposed architecture can be…

Machine Learning · Computer Science 2022-01-07 Yiju Yang , Tianxiao Zhang , Guanyu Li , Taejoon Kim , Guanghui Wang

Machine learning techniques are steadily becoming more important in modern biology, and are used to build predictive models, discover patterns, and investigate biological problems. However, models trained on one dataset are often not…

Quantitative Methods · Quantitative Biology 2024-05-30 Seyedmehdi Orouji , Martin C. Liu , Tal Korem , Megan A. K. Peters

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Inspired by two basic mechanisms in animal visual systems, we introduce a feature transform technique that imposes invariance properties in the training of deep neural networks. The resulting algorithm requires less parameter tuning, trains…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Chengxi Ye , Xiong Zhou , Tristan McKinney , Yanfeng Liu , Qinggang Zhou , Fedor Zhdanov

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been studied within the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yaxing Wang , Chenshen Wu , Luis Herranz , Joost van de Weijer , Abel Gonzalez-Garcia , Bogdan Raducanu

Recent advances in unsupervised domain adaptation have shown the effectiveness of adversarial training to adapt features across domains, endowing neural networks with the capability of being tested on a target domain without requiring any…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mikel Menta , Adriana Romero , Joost van de Weijer

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

Multi-Domain Learning (MDL) refers to the problem of learning a set of models derived from a common deep architecture, each one specialized to perform a task in a certain domain (e.g., photos, sketches, paintings). This paper tackles MDL…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Rodrigo Berriel , Stéphane Lathuilière , Moin Nabi , Tassilo Klein , Thiago Oliveira-Santos , Nicu Sebe , Elisa Ricci

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

Machine Learning · Computer Science 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions. The primary difficulty in…

Machine Learning · Computer Science 2017-08-11 Wenhao Jiang , Cheng Deng , Wei Liu , Feiping Nie , Fu-lai Chung , Heng Huang

An essential problem in domain adaptation is to understand and make use of distribution changes across domains. For this purpose, we first propose a flexible Generative Domain Adaptation Network (G-DAN) with specific latent variables to…

Machine Learning · Statistics 2018-06-29 Mingming Gong , Kun Zhang , Biwei Huang , Clark Glymour , Dacheng Tao , Kayhan Batmanghelich

Training deep neural networks (DNNs) is computationally expensive, which is problematic especially when performing duplicated or similar training runs in model ensemble or fine-tuning pre-trained models, for example. Once we have trained…

Machine Learning · Computer Science 2023-10-04 Daiki Chijiwa

Transfer learning entails taking an artificial neural network (ANN) that is trained on a source dataset and adapting it to a new target dataset. While this has been shown to be quite powerful, its use has generally been restricted by…

Neural and Evolutionary Computing · Computer Science 2020-06-05 AbdElRahman ElSaid , Joshua Karns , Alexander Ororbia , Daniel Krutz , Zimeng Lyu , Travis Desell

In practical machine learning settings, the data on which a model must make predictions often come from a different distribution than the data it was trained on. Here, we investigate the problem of unsupervised multi-source domain…

Machine Learning · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

Information Theory · Computer Science 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

In the problem of domain transfer learning, we learn a model for the predic-tion in a target domain from the data of both some source domains and the target domain, where the target domain is in lack of labels while the source domain has…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Guohui Zhang , Gaoyuan Liang , Fang Su , Fanxin Qu , Jing-Yan Wang

In this paper, we study the problem of transfer learning with the attribute data. In the transfer learning problem, we want to leverage the data of the auxiliary and the target domains to build an effective model for the classification…

Machine Learning · Computer Science 2018-04-03 Fang Su , Jing-Yan Wang

Reducing feature redundancy has shown beneficial effects for improving the accuracy of deep learning models, thus it is also indispensable for the models of unsupervised domain adaptation (UDA). Nevertheless, most recent efforts in the…

Machine Learning · Computer Science 2021-01-01 Mengzhu Wang , Xiang Zhang , Long Lan , Wei Wang , Huibin Tan , Zhigang Luo