English
Related papers

Related papers: Kernel Alignment for Unsupervised Transfer Learnin…

200 papers

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

Machine Learning · Computer Science 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Since we can leverage a large amount of unlabeled data without any human supervision to train a model and transfer the knowledge to target tasks, self-supervised learning is a de-facto component for the recent success of deep learning in…

Computation and Language · Computer Science 2021-03-12 Donggyu Kim , Seanie Lee

Domain adaptation is an essential task in transfer learning to leverage data in one domain to bolster learning in another domain. In this paper, we present a new semi-supervised manifold alignment technique based on a two-step approach of…

Machine Learning · Computer Science 2020-11-12 Stefan Dernbach , Don Towsley

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

Pre-training a deep neural network on the ImageNet dataset is a common practice for training deep learning models, and generally yields improved performance and faster training times. The technique of pre-training on one task and then…

Machine Learning · Computer Science 2020-01-03 Nishai Kooverjee , Steven James , Terence van Zyl

Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power…

Machine Learning · Computer Science 2022-12-20 Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

The optimization of Kernel-Target Alignment (TA) has been recently proposed as a way to reduce the number of hardware resources in quantum classifiers. It allows to exchange highly expressive and costly circuits to moderate size, task…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Artur Miroszewski , Jakub Mielczarek , Filip Szczepanek , Grzegorz Czelusta , Bartosz Grabowski , Bertrand Le Saux , Jakub Nalepa

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Multi-task learning is a natural approach for computer vision applications that require the simultaneous solution of several distinct but related problems, e.g. object detection, classification, tracking of multiple agents, or denoising, to…

Machine Learning · Computer Science 2015-04-14 Carlo Ciliberto , Lorenzo Rosasco , Silvia Villa

Machine learning algorithms typically require abundant data under a stationary environment. However, environments are nonstationary in many real-world applications. Critical issues lie in how to effectively adapt models under an…

Machine Learning · Statistics 2020-06-29 Masaaki Takada , Hironori Fujisawa

One crucial objective of multi-task learning is to align distributions across tasks so that the information between them can be transferred and shared. However, existing approaches only focused on matching the marginal feature distribution…

Machine Learning · Computer Science 2021-03-04 Fan Zhou , Brahim Chaib-draa , Boyu Wang

Theoretical studies on transfer learning or domain adaptation have so far focused on situations with a known hypothesis class or model; however in practice, some amount of model selection is usually involved, often appearing under the…

Machine Learning · Statistics 2023-10-13 Steve Hanneke , Samory Kpotufe , Yasaman Mahdaviyeh

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

Transfer learning approaches in reinforcement learning aim to assist agents in learning their target domains by leveraging the knowledge learned from other agents that have been trained on similar source domains. For example, recent…

Machine Learning · Computer Science 2022-04-25 Nathan Beck , Abhiramon Rajasekharan , Hieu Tran

Kernel alignment measures the degree of similarity between two kernels. In this paper, inspired from kernel alignment, we propose a new Linear Discriminant Analysis (LDA) formulation, kernel alignment LDA (kaLDA). We first define two…

Machine Learning · Computer Science 2016-10-17 Shuai Zheng , Chris Ding

In self-supervised learning, one trains a model to solve a so-called pretext task on a dataset without the need for human annotation. The main objective, however, is to transfer this model to a target domain and task. Currently, the most…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mehdi Noroozi , Ananth Vinjimoor , Paolo Favaro , Hamed Pirsiavash

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

Remote sensing image classification exploiting multiple sensors is a very challenging problem: data from different modalities are affected by spectral distortions and mis-alignments of all kinds, and this hampers re-using models built for…

Signal Processing · Electrical Eng. & Systems 2020-12-09 Devis Tuia , Diego Marcos , Gustau Camps-Valls

Recently, different machine learning methods have been introduced to tackle the challenging few-shot learning scenario that is, learning from a small labeled dataset related to a specific task. Common approaches have taken the form of…

Machine Learning · Computer Science 2020-10-14 Massimiliano Patacchiola , Jack Turner , Elliot J. Crowley , Michael O'Boyle , Amos Storkey

Transfer learning seeks to improve the generalization performance of a target task by exploiting the knowledge learned from a related source task. Central questions include deciding what information one should transfer and when transfer can…

Machine Learning · Computer Science 2021-04-07 Oussama Dhifallah , Yue M. Lu
‹ Prev 1 8 9 10 Next ›