English
Related papers

Related papers: Memory Transfer Learning: How Memories are Transfe…

200 papers

Aided target recognition (AiTR), the problem of classifying objects from sensor data, is an important problem with applications across industry and defense. While classification algorithms continue to improve, they often require more…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Samuel Rivera , Olga Mendoza-Schrock , Ashley Diehl

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has…

Machine Learning · Computer Science 2023-09-20 Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , Peter J. Liu

Human activity recognition aims to recognize the activities of daily living by utilizing the sensors on different body parts. However, when the labeled data from a certain body position (i.e. target domain) is missing, how to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Yiqiang Chen , Jindong Wang , Meiyu Huang , Han Yu

Machine systems inherently generate signals in which fault conditions and various variables influence signals measured from machine system. Although many existing fault classification studies rely solely on direct fault labels, the…

Machine Learning · Computer Science 2026-03-24 Wonjun Yi , Rismaya Kumar Mishra , Yong-Hwa Park

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yixiong Chen , Jingxian Li , Chris Ding , Li Liu

Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the…

Machine Learning · Computer Science 2022-07-06 Jun Wu , Jingrui He

Despite its success, existing in-context learning (ICL) relies on in-domain expert demonstrations, limiting its applicability when expert annotations are scarce. We posit that different domains may share underlying reasoning structures,…

Artificial Intelligence · Computer Science 2026-04-08 Le Liu , Zhiming Li , Jianzhi Yan , Zike Yuan , Shiwei Chen , Youcheng Pan , Buzhou Tang , Qingcai Chen , Yang Xiang , Danny Dongning Sun

When the available data for a target domain is limited, transfer learning (TL) methods can be used to develop models on related data-rich domains, before deploying them on the target domain. However, these TL methods are typically designed…

Statistical Finance · Quantitative Finance 2025-08-06 Ricardo Ribeiro Pereira , Jacopo Bono , Hugo Ferreira , Pedro Ribeiro , Carlos Soares , Pedro Bizarro

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Recent studies provide large language models (LLMs) with textual task-solving experiences via prompts to improve their performance. However, previous methods rely on substantial human labor or time to gather such experiences for each task,…

Computation and Language · Computer Science 2025-05-30 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bibo Cai , Bing Qin , Ting Liu

Previous transfer learning methods based on deep network assume the knowledge should be transferred between the same hidden layers of the source domain and the target domains. This assumption doesn't always hold true, especially when the…

Machine Learning · Computer Science 2018-09-25 Jianzhe Lin , Qi Wang , Rabab Ward , Z. Jane Wang

Transfer learning across heterogeneous data distributions (a.k.a. domains) and distinct tasks is a more general and challenging problem than conventional transfer learning, where either domains or tasks are assumed to be the same. While…

Machine Learning · Computer Science 2021-03-26 Yang Tan , Yang Li , Shao-Lun Huang

Transfer Learning (TL) plays a crucial role when a given dataset has insufficient labeled examples to train an accurate model. In such scenarios, the knowledge accumulated within a model pre-trained on a source dataset can be transferred to…

Computation and Language · Computer Science 2018-01-22 Tushar Semwal , Gaurav Mathur , Promod Yenigalla , Shivashankar B. Nair

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

We consider the Hypothesis Transfer Learning (HTL) problem where one incorporates a hypothesis trained on the source domain into the learning procedure of the target domain. Existing theoretical analysis either only studies specific…

Machine Learning · Statistics 2017-11-07 Simon Shaolei Du , Jayanth Koushik , Aarti Singh , Barnabas Poczos

Natural Language Processing (NLP) has seen remarkable advances in recent years, particularly with the emergence of Large Language Models that have achieved unprecedented performance across many tasks. However, these developments have mainly…

Computation and Language · Computer Science 2025-02-06 Iker García-Ferrero

Through this project, we researched on transfer learning methods and their applications on real world problems. By implementing and modifying various methods in transfer learning for our problem, we obtained an insight in the advantages and…

Machine Learning · Computer Science 2017-07-11 Hailin Chen , Shengping Cui , Sebastian Li

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

Computation and Language · Computer Science 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

Transfer learning on tabular data is challenging due to disparate feature spaces across domains, in contrast to the homogeneous structures of image and text. Large language models (LLMs) offer a knowledge base to improve the limited…

Machine Learning · Computer Science 2026-01-26 Ibna Kowsar , Kazi F. Akhter , Manar D. Samad

Transferring knowledge across many streaming processes remains an uncharted territory in the existing literature and features unique characteristics: no labelled instance of the target domain, covariate shift of source and target domain,…

Machine Learning · Computer Science 2019-10-22 Mahardhika Pratama , Marcus de Carvalho , Renchunzi Xie , Edwin Lughofer , Jie Lu