English
Related papers

Related papers: Estimation and inference for transfer learning wit…

200 papers

Regression prediction plays a crucial role in practical applications and strongly relies on data annotation. However, due to prohibitive annotation costs or domain-specific constraints, labeled data in the target domain is often scarce,…

Methodology · Statistics 2025-09-25 Bingbing Wang , Jiaqi Wang , Yu Tang

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

As a new classification platform, deep learning has recently received increasing attention from researchers and has been successfully applied to many domains. In some domains, like bioinformatics and robotics, it is very difficult to…

Machine Learning · Computer Science 2018-08-13 Chuanqi Tan , Fuchun Sun , Tao Kong , Wenchang Zhang , Chao Yang , Chunfang Liu

We study transfer learning for estimating piecewise-constant signals when source data, which may be relevant but disparate, are available in addition to the target data. We first investigate transfer learning estimators that respectively…

Methodology · Statistics 2024-07-30 Fan Wang , Yi Yu

A crucial challenge in reinforcement learning is to reduce the number of interactions with the environment that an agent requires to master a given task. Transfer learning proposes to address this issue by re-using knowledge from previously…

Machine Learning · Computer Science 2023-04-28 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Previous transfer learning methods based on deep network assume the knowledge should be transferred between the same hidden layers of the source domain and the target domains. This assumption doesn't always hold true, especially when the…

Machine Learning · Computer Science 2018-09-25 Jianzhe Lin , Qi Wang , Rabab Ward , Z. Jane Wang

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as…

Machine Learning · Computer Science 2017-11-10 Tianchun Wang

Given a set of heterogeneous source datasets with their classifiers, how can we quickly find the most useful source dataset for a specific target task? We address the problem of measuring transferability between source and target datasets,…

Machine Learning · Computer Science 2021-02-01 Seungcheol Park , Huiwen Xu , Taehun Kim , Inhwan Hwang , Kyung-Jun Kim , U Kang

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Transfer learning is a popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. It has enjoyed numerous empirical successes and inspired a growing number of theoretical studies.…

Machine Learning · Computer Science 2023-05-23 Haoyang Cao , Haotian Gu , Xin Guo

Transfer learning enhances model performance by utilizing knowledge from related domains, particularly when labeled data is scarce. While existing research addresses transfer learning under various distribution shifts in independent…

Machine Learning · Computer Science 2025-04-30 Liyuan Wang , Jiachen Chen , Kathryn L. Lunetta , Danyang Huang , Huimin Cheng , Debarghya Mukherjee

We study the transfer learning process between two linear regression problems. An important and timely special case is when the regressors are overparameterized and perfectly interpolate their training data. We examine a parameter transfer…

Machine Learning · Computer Science 2022-09-29 Yehuda Dar , Richard G. Baraniuk

We develop here a novel transfer learning methodology called Profiled Transfer Learning (PTL). The method is based on the \textit{approximate-linear} assumption between the source and target parameters. Compared with the commonly assumed…

Statistics Theory · Mathematics 2024-06-06 Ziqian Lin , Junlong Zhao , Fang Wang , Hansheng Wang

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Multi-source transfer learning has been proven effective when within-target labeled data is scarce. Previous work focuses primarily on exploiting domain similarities and assumes that source domains are richly or at least comparably labeled.…

Machine Learning · Computer Science 2018-07-09 Zirui Wang , Jaime Carbonell

Transfer learning seeks to accelerate sequential decision-making by leveraging offline data from related agents. However, data from heterogeneous sources that differ in observed features, distributions, or unobserved confounders often…

Machine Learning · Computer Science 2025-07-10 Xueping Gong , Wei You , Jiheng Zhang

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

Development of comprehensive prediction models are often of great interest in many disciplines of science, but datasets with information on all desired features often have small sample sizes. We describe a transfer learning approach for…

Methodology · Statistics 2024-08-20 Ruzhang Zhao , Prosenjit Kundu , Arkajyoti Saha , Nilanjan Chatterjee