English
Related papers

Related papers: Kernel Alignment for Unsupervised Transfer Learnin…

200 papers

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

With the rise of Visual and Language Pretraining (VLP), an increasing number of downstream tasks are adopting the paradigm of pretraining followed by fine-tuning. Although this paradigm has demonstrated potential in various multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Tengjun Huang

The models and weights of prior trained Convolutional Neural Networks (CNN) created to perform automated isotopic classification of time-sequenced gamma-ray spectra, were utilized to provide source domain knowledge as training on new…

Data Analysis, Statistics and Probability · Physics 2020-03-25 Eric T. Moore , Johanna L. Turk , William P. Ford , Nathan J. Hoteling , Lance S. McLean

We study the problem of unsupervised domain adaptation, which aims to adapt classifiers trained on a labeled source domain to an unlabeled target domain. Many existing approaches first learn domain-invariant features and then construct…

Machine Learning · Computer Science 2012-07-03 Yuan Shi , Fei Sha

Meta-learning automatically infers an inductive bias by observing data from a number of related tasks. The inductive bias is encoded by hyperparameters that determine aspects of the model class or training algorithm, such as initialization…

Machine Learning · Computer Science 2020-11-10 Sharu Theresa Jose , Osvaldo Simeone , Giuseppe Durisi

Transfer learning aims to solve the data sparsity for a target domain by applying information of the source domain. Given a sequence (e.g. a natural language sentence), the transfer learning, usually enabled by recurrent neural network…

Computation and Language · Computer Science 2019-02-26 Wanyun Cui , Guangyu Zheng , Zhiqiang Shen , Sihang Jiang , Wei Wang

Knowledge transfer using convolutional neural networks (CNNs) can help efficiently train a CNN with fewer parameters or maximize the generalization performance under limited supervision. To enable a more efficient transfer of pretrained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Seungbum Hong , Jihun Yoon , Junmo Kim , Min-Kook Choi

The aim of knowledge base completion is to predict unseen facts from existing facts in knowledge bases. In this work, we introduce the first approach for transfer of knowledge from one collection of facts to another without the need for…

Computation and Language · Computer Science 2021-08-31 Vid Kocijan , Thomas Lukasiewicz

In most applications of utilizing neural networks for mathematical optimization, a dedicated model is trained for each specific optimization objective. However, in many scenarios, several distinct yet correlated objectives or tasks often…

Machine Learning · Computer Science 2024-04-15 Wei Cui , Wei Yu

Recognizing new objects by learning from a few labeled examples in an evolving environment is crucial to obtain excellent generalization ability for real-world machine learning systems. A typical setting across current meta learning…

Machine Learning · Computer Science 2021-09-30 Zhenyi Wang , Tiehang Duan , Le Fang , Qiuling Suo , Mingchen Gao

Sequential training from task to task is becoming one of the major objects in deep learning applications such as continual learning and transfer learning. Nevertheless, it remains unclear under what conditions the trained model's…

Machine Learning · Statistics 2022-03-21 Ryo Karakida , Shotaro Akaho

Bilevel optimization has emerged as a technique for addressing a wide range of machine learning problems that involve an outer objective implicitly determined by the minimizer of an inner problem. While prior works have primarily focused on…

Machine Learning · Computer Science 2025-11-18 Fares El Khoury , Edouard Pauwels , Samuel Vaiter , Michael Arbel

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Statistical analysis of network data has attracted considerable attention in recent years, due to the rapid advancement of well-trained network models and the accessibility of large public network datasets. In this article, we propose a…

Methodology · Statistics 2026-04-22 Yong He , Kangxiang Qin , Haoran Tang

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza

The goal of transfer learning (TL) is providing a framework for exploiting acquired knowledge from source to target data. Transfer learning approaches compared to traditional machine learning approaches are capable of modeling better data…

Artificial Intelligence · Computer Science 2022-06-23 Mohamad Zamini , Eunjin Kim

Knowledge Transfer has been applied in solving a wide variety of problems. For example, knowledge can be transferred between tasks (e.g., learning to handle novel situations by leveraging prior knowledge) or between agents (e.g., learning…

Machine Learning · Computer Science 2020-08-25 Qing Sun , James Cross

Most existing multi-source domain adaptation (MSDA) methods minimize the distance between multiple source-target domain pairs via feature distribution alignment, an approach borrowed from the single source setting. However, with diverse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhongying Deng , Kaiyang Zhou , Yongxin Yang , Tao Xiang

In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer…

Machine Learning · Computer Science 2019-03-25 Sebastian Flennerhag , Pablo G. Moreno , Neil D. Lawrence , Andreas Damianou