English
Related papers

Related papers: Transfer Learning across Networks for Collective C…

200 papers

Transfer learning aims to learn classifiers for a target domain by transferring knowledge from a source domain. However, due to two main issues: feature discrepancy and distribution divergence, transfer learning can be a very difficult…

Machine Learning · Computer Science 2022-09-05 Md Geaur Rahman , Md Zahidul Islam

Multi-label zero-shot classification aims to predict multiple unseen class labels for an input image. It is more challenging than its single-label counterpart. On one hand, the unconstrained number of labels assigned to each image makes the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 He Huang , Yuanwei Chen , Wei Tang , Wenhao Zheng , Qing-Guo Chen , Yao Hu , Philip Yu

Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes…

Computation and Language · Computer Science 2017-08-15 Sunil Kumar Sahu , Ashish Anand

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar

In this paper, we study the problem of transfer learning with the attribute data. In the transfer learning problem, we want to leverage the data of the auxiliary and the target domains to build an effective model for the classification…

Machine Learning · Computer Science 2018-04-03 Fang Su , Jing-Yan Wang

The goal of few-shot learning is to learn a classifier that generalizes well even when trained with a limited number of training instances per class. The recently introduced meta-learning approaches tackle this problem by learning a generic…

Machine Learning · Computer Science 2019-02-11 Yanbin Liu , Juho Lee , Minseop Park , Saehoon Kim , Eunho Yang , Sung Ju Hwang , Yi Yang

Deep networks, composed of multiple layers of hierarchical distributed representations, tend to learn low-level features in initial layers and transition to high-level features towards final layers. Paradigms such as transfer learning,…

Machine Learning · Computer Science 2018-11-30 Haytham M. Fayek , Lawrence Cavedon , Hong Ren Wu

In this paper we address the problem of modeling relational data, which appear in many applications such as social network analysis, recommender systems and bioinformatics. Previous studies either consider latent feature based models but…

Data Structures and Algorithms · Computer Science 2012-04-13 Sheng Gao , Ludovic Denoyer , Patrick Gallinari

In open set learning, a model must be able to generalize to novel classes when it encounters a sample that does not belong to any of the classes it has seen before. Open set learning poses a realistic learning scenario that is receiving…

Machine Learning · Computer Science 2018-11-27 Chengsheng Mao , Liang Yao , Yuan Luo

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Transfer learning aims to leverage knowledge from pre-trained models to benefit the target task. Prior transfer learning work mainly transfers from a single model. However, with the emergence of deep models pre-trained from different…

Machine Learning · Computer Science 2022-11-07 Yang Shu , Zhangjie Cao , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Transfer learning is a very important tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2020-01-24 Daniel Jakubovitz , Miguel R. D. Rodrigues , Raja Giryes

Cross-network node classification (CNNC), which aims to classify nodes in a label-deficient target network by transferring the knowledge from a source network with abundant labels, draws increasing attention recently. To address CNNC, we…

Machine Learning · Computer Science 2023-10-18 Xiao Shen , Shirui Pan , Kup-Sze Choi , Xi Zhou

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

The proliferation of edge networks creates islands of learning agents working on local streams of data. Transferring knowledge between these agents in real-time without exposing private data allows for collaboration to decrease learning…

Machine Learning · Computer Science 2021-10-04 Orpaz Goldstein , Mohammad Kachuee , Derek Shiell , Majid Sarrafzadeh

In this paper, we propose a generative knowledge transfer technique that trains an RNN based language model (student network) using text and output probabilities generated from a previously trained RNN (teacher network). The text generation…

Machine Learning · Computer Science 2017-03-01 Sungho Shin , Kyuyeon Hwang , Wonyong Sung

When labeled data is scarce for a specific target task, transfer learning often offers an effective solution by utilizing data from a related source task. However, when transferring knowledge from a less related source, it may inversely…

Machine Learning · Computer Science 2019-10-08 Zirui Wang , Zihang Dai , Barnabás Póczos , Jaime Carbonell

Learning with a limited number of labeled data is a central problem in real-world applications of machine learning, as it is often expensive to obtain annotations. To deal with the scarcity of labeled data, transfer learning is a…

Computation and Language · Computer Science 2024-08-22 Jaehyun Nam , Woomin Song , Seong Hyeon Park , Jihoon Tack , Sukmin Yun , Jaehyung Kim , Kyu Hwan Oh , Jinwoo Shin

Transfer learning is a valuable tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2023-06-13 Daniel Jakubovitz , David Uliel , Miguel Rodrigues , Raja Giryes