English
Related papers

Related papers: Deep Variational Transfer: Transfer Learning throu…

200 papers

Deep learning based task systems normally rely on a large amount of manually labeled training data, which is expensive to obtain and subject to operator variations. Moreover, it does not always hold that the manually labeled data and the…

Machine Learning · Computer Science 2019-07-25 Jun Chen , Heye Zhang , Yanping Zhang , Shu Zhao , Raad Mohiaddin , Tom Wong , David Firmin , Guang Yang , Jennifer Keegan

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

In this work, we aim to establish a Bayesian adaptive learning framework by focusing on estimating latent variables in deep neural network (DNN) models. Latent variables indeed encode both transferable distributional information and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Hu Hu , Sabato Marco Siniscalchi , Chin-Hui Lee

Recent advances in semi-supervised learning with deep generative models have shown promise in generalizing from small labeled datasets ($\mathbf{x},\mathbf{y}$) to large unlabeled ones ($\mathbf{x}$). In the case where the codomain has…

Machine Learning · Computer Science 2017-08-25 Ian Gemp , Ishan Durugkar , Mario Parente , M. Darby Dyar , Sridhar Mahadevan

Deep learning-based domain adaptation (DA) methods have shown strong performance by learning transferable representations. However, their reliance on mini-batch training limits global distribution modeling, leading to unstable alignment and…

Machine Learning · Computer Science 2025-11-18 Lingkun Luo , Shiqiang Hu , Liming Chen

Transfer learning is crucial in training deep neural networks on new target tasks. Current transfer learning methods always assume at least one of (i) source and target task label spaces overlap, (ii) source datasets are available, and…

Machine Learning · Computer Science 2025-02-21 Shin'ya Yamaguchi , Sekitoshi Kanai , Atsutoshi Kumagai , Daiki Chijiwa , Hisashi Kashima

To leverage machine learning in any decision-making process, one must convert the given knowledge (for example, natural language, unstructured text) into representation vectors that can be understood and processed by machine learning model…

Machine Learning · Computer Science 2023-07-11 Shibo Yao

Transfer learning is widely used for training deep neural networks (DNN) for building a powerful representation. Even after the pre-trained model is adapted for the target task, the representation performance of the feature extractor is…

Machine Learning · Computer Science 2023-08-22 Seunghee Koh , Hyounguk Shon , Janghyeon Lee , Hyeong Gwon Hong , Junmo Kim

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Recent reports suggest that a generic supervised deep CNN model trained on a large-scale dataset reduces, but does not remove, dataset bias. Fine-tuning deep models in a new domain can require a significant amount of labeled data, which for…

Computer Vision and Pattern Recognition · Computer Science 2015-10-09 Eric Tzeng , Judy Hoffman , Trevor Darrell , Kate Saenko

Transfer learning, which is to improve the learning performance in the target domain by leveraging useful knowledge from the source domain, often requires that those two domains are very close, which limits its application scope. Recently,…

Machine Learning · Computer Science 2020-06-16 Qiao Xiao , Yu Zhang

The performance of deep learning based semantic segmentation models heavily depends on sufficient data with careful annotations. However, even the largest public datasets only provide samples with pixel-level annotations for rather limited…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Huaxin Xiao , Yunchao Wei , Yu Liu , Maojun Zhang , Jiashi Feng

The accuracy and robustness of image classification with supervised deep learning are dependent on the availability of large-scale, annotated training data. However, there is a paucity of annotated data available due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Due to the costliness of labelled data in real-world applications, semi-supervised learning, underpinned by pseudo labelling, is an appealing solution. However, handling confusing samples is nontrivial: discarding valuable confusing samples…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Changrui Chen , Jungong Han , Kurt Debattista

Deep Neural Networks (DNNs) deployed to the real world are regularly subject to out-of-distribution (OoD) data, various types of noise, and shifting conceptual objectives. This paper proposes a framework for adapting to data distribution…

Machine Learning · Computer Science 2023-08-24 Christopher Angelini , Nidhal Bouaynaya , Ghulam Rasool

This paper addresses the problem of transferring useful knowledge from a source network to predict node labels in a newly formed target network. While existing transfer learning research has primarily focused on vector-based data, in which…

Machine Learning · Computer Science 2016-11-15 Meng Fang , Jie Yin , Xingquan Zhu

Variational autoencoder is a powerful deep generative model with variational inference. The practice of modeling latent variables in the VAE's original formulation as normal distributions with a diagonal covariance matrix limits the…

Machine Learning · Computer Science 2019-03-11 Sarin Chandy , Amin Rasekh

Graph representation learning is a fundamental problem for modeling relational data and benefits a number of downstream applications. Traditional Bayesian-based graph models and recent deep learning based GNN either suffer from…

Machine Learning · Computer Science 2024-03-27 Hanxuan Yang , Qingchao Kong , Wenji Mao

The generalization power of deep-learning models is dependent on rich-labelled data. This supervision using large-scaled annotated information is restrictive in most real-world scenarios where data collection and their annotation involve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Sandipan Choudhuri , Riti Paul , Arunabha Sen , Baoxin Li , Hemanth Venkateswara

Most of the data-driven approaches applied to bearing fault diagnosis up to date are established in the supervised learning paradigm, which usually requires a large set of labeled data collected a priori. In practical applications, however,…

Machine Learning · Computer Science 2019-12-10 Shen Zhang , Fei Ye , Bingnan Wang , Thomas G. Habetler