English
Related papers

Related papers: Transfer Learning for High-dimensional Linear Regr…

200 papers

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

Precision matrix estimation is essential in various fields; yet it is challenging when samples for the target study are limited. Transfer learning can enhance estimation accuracy by leveraging data from related source studies. We propose…

Machine Learning · Statistics 2026-03-31 Boxin Zhao , Cong Ma , Mladen Kolar

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

This paper studies high-dimensional additive regression under the transfer learning framework, where one observes samples from a target population together with auxiliary samples from different but potentially related regression models. We…

Machine Learning · Statistics 2025-09-17 Seung Hyun Moon

In this paper, we consider the problem of learning a linear regression model on a data domain of interest (target) given few samples. To aid learning, we are provided with a set of pre-trained regression models that are trained on…

Machine Learning · Computer Science 2023-06-27 Navjot Singh , Suhas Diggavi

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

There are many time series in the literature with high dimension yet limited sample sizes, such as macroeconomic variables, and it is almost impossible to obtain efficient estimation and accurate prediction by using the corresponding…

Methodology · Statistics 2025-10-30 Yuchang Lin , Qianqian Zhu , Guodong Li

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges…

Methodology · Statistics 2026-03-23 Bo Fu , Dandan Jiang

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial…

Machine Learning · Statistics 2025-01-09 Hongzhe Zhang , Arnab Auddy , Hongzhe Lee

We develop here a novel transfer learning methodology called Profiled Transfer Learning (PTL). The method is based on the \textit{approximate-linear} assumption between the source and target parameters. Compared with the commonly assumed…

Statistics Theory · Mathematics 2024-06-06 Ziqian Lin , Junlong Zhao , Fang Wang , Hansheng Wang

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

In transfer learning, the learner leverages auxiliary data to improve generalization on a main task. However, the precise theoretical understanding of when and how auxiliary data help remains incomplete. We provide new insights on this…

Machine Learning · Computer Science 2026-03-31 Meitong Liu , Christopher Jung , Rui Li , Xue Feng , Han Zhao

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng

Correlated outcomes are common in many practical problems. In some settings, one outcome is of particular interest, and others are auxiliary. To leverage information shared by all the outcomes, traditional multi-task learning (MTL)…

Methodology · Statistics 2023-03-23 Muxuan Liang , Jaeyoung Park , Qing Lu , Xiang Zhong

Transfer learning is beneficial for survival analysis, especially when the target study has a limited number of events. However, existing transfer learning methods rely on the restrictive assumption that the target and source studies share…

Methodology · Statistics 2026-03-13 Yu Gu , Donglin Zeng , D. Y. Lin
‹ Prev 1 2 3 10 Next ›