English
Related papers

Related papers: Transfer Learning in Regression with Influential P…

200 papers

In many practical data mining scenarios, such as network intrusion detection, Twitter spam detection, and computer-aided diagnosis, a source domain that is different from but related to a target domain is very common. In addition, a large…

Machine Learning · Computer Science 2021-08-24 Zhe Yuan , Yimin Wen

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang

The main challenge that sets transfer learning apart from traditional supervised learning is the distribution shift, reflected as the shift between the source and target models and that between the marginal covariate distributions. In this…

Machine Learning · Statistics 2024-04-02 Zelin He , Ying Sun , Jingyuan Liu , Runze Li

High-dimensional data in modern applications, such as COVID-19 mortality, often span multiple domains. Leveraging auxiliary information from source domains to improve performance in a target domain motivates the use of transfer learning.…

Methodology · Statistics 2026-04-09 Haoming Shi , Yang Feng , Xiaoqian Liu

Transfer learning refers to the promising idea of initializing model fits based on pre-training on other data. We particularly consider regression modeling settings where parameter estimates from previous data can be used as anchoring…

Methodology · Statistics 2020-07-07 Wessel N. van Wieringen , Harald Binder

This paper considers the estimation and prediction of a high-dimensional linear regression in the setting of transfer learning, using samples from the target model as well as auxiliary samples from different but possibly related regression…

Methodology · Statistics 2020-06-19 Sai Li , T. Tony Cai , Hongzhe Li

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

Transfer learning allows practitioners to recognize and apply knowledge learned in previous tasks (source task) to new tasks or new domains (target task), which share some commonality. The two important factors impacting the performance of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Michael Bernico , Yuntao Li , Dingchao Zhang

Transfer learning aims to improve performance on a target task by leveraging information from related source tasks. We propose a nonparametric regression transfer learning framework that explicitly models heterogeneity in the source-target…

Statistics Theory · Mathematics 2026-03-19 Hélène Halconruy , Benjamin Bobbia , Paul Lejamtel

With the extensive applications of machine learning models, automatic hyperparameter optimization (HPO) has become increasingly important. Motivated by the tuning behaviors of human experts, it is intuitive to leverage auxiliary knowledge…

Machine Learning · Computer Science 2022-06-07 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Zhi Yang , Ce Zhang , Bin Cui

Randomized clinical trials are the gold standard for analyzing treatment effects, but high costs and ethical concerns can limit recruitment, potentially leading to invalid inferences. Incorporating external trial data with similar…

Methodology · Statistics 2024-09-09 Yujia Gu , Hanzhong Liu , Wei Ma

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean…

Machine Learning · Computer Science 2025-10-24 Kaicheng Zhang , Sinian Zhang , Doudou Zhou , Yidong Zhou

Supervised learning models are typically trained on a single dataset and the performance of these models rely heavily on the size of the dataset, i.e., amount of data available with the ground truth. Learning algorithms try to generalize…

Computation and Language · Computer Science 2018-02-19 Somnath Basu Roy Chowdhury , K M Annervaz , Ambedkar Dukkipati

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

Information Theory · Computer Science 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

The goal of data attribution is to trace the model's predictions through the learning algorithm and back to its training data. thereby identifying the most influential training samples and understanding how the model's behavior leads to…

Machine Learning · Computer Science 2025-08-12 Hongbo Zhu , Angelo Cangelosi

Transfer learning has been successfully applied across many high-impact applications. However, most existing work focuses on the static transfer learning setting, and very little is devoted to modeling the time evolving target domain, such…

Machine Learning · Computer Science 2020-06-08 Jun Wu , Jingrui He

It is commonly believed that in transfer learning including more pre-training data translates into better performance. However, recent evidence suggests that removing data from the source dataset can actually help too. In this work, we take…

Machine Learning · Computer Science 2022-07-13 Saachi Jain , Hadi Salman , Alaa Khaddaj , Eric Wong , Sung Min Park , Aleksander Madry

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges…

Methodology · Statistics 2026-03-23 Bo Fu , Dandan Jiang