English
Related papers

Related papers: Generalized optimal parameter-transfer learning th…

200 papers

Model averaging, as an appealing ensemble technique, strategically integrates all valuable information from candidate models to construct fast and accurate prediction. Despite of having been widely practiced in many fields such as…

Methodology · Statistics 2026-03-17 Zhuang Yong , Lv Jing , Tingting Li

In multi-source transfer learning, a key challenge lies in how to appropriately differentiate and utilize heterogeneous source tasks. However, existing multi-source methods typically focus on optimizing either the source weights or the…

Machine Learning · Computer Science 2026-04-03 Qingyue Zhang , Chang Chu , Haohao Fu , Tianren Peng , Yanru Wu , Guanbo Huang , Yang Li , Shao-Lun Huang

Many pre-trained models (PTMs) are available in modern applications. Because different PTMs are often trained on different datasets, their performances can vary substantially for different new tasks, and the ranking of the candidates may…

Methodology · Statistics 2026-05-14 Ziwen Gao , Baihua He , Yuhong Yang

Transfer learning is beneficial for survival analysis, especially when the target study has a limited number of events. However, existing transfer learning methods rely on the restrictive assumption that the target and source studies share…

Methodology · Statistics 2026-03-13 Yu Gu , Donglin Zeng , D. Y. Lin

Positive-Unlabeled (PU) learning presents unique challenges due to the lack of explicitly labeled negative samples, particularly in high-stakes domains such as fraud detection and medical diagnosis. To address data scarcity and privacy…

Machine Learning · Statistics 2025-11-17 Jialei Liu , Jun Liao , Kuangnan Fang

Recent years, transfer learning has attracted much attention in the community of machine learning. In this paper, we mainly focus on the tasks of parameter transfer under the framework of extreme learning machine (ELM). Unlike the existing…

Machine Learning · Computer Science 2018-10-24 Chao Chen , Boyuan Jiang , Xinyu Jin

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

Link prediction in multilayer networks is a key challenge in applications such as recommendation systems and protein-protein interaction prediction. While many techniques have been developed, most rely on assumptions about shared structures…

Machine Learning · Statistics 2025-06-17 Yongqin Qiu , Xinyu Zhang

When the transferable set is unknowable, transfering informative knowledge as much as possible\textemdash a principle we refer to as \emph{sufficiency}, becomes crucial for enhancing transfer learning effectiveness. However, existing…

Methodology · Statistics 2025-07-22 Xiyuan Zhang , Huihang Liu , Xinyu Zhang

This paper is concerned with model averaging estimation for partially linear functional score models. These models predict a scalar response using both parametric effect of scalar predictors and non-parametric effect of a functional…

Methodology · Statistics 2021-05-04 Shishi Liu , Hao Zhang , Jingxiao Zhang

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

Machine Learning · Statistics 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Model averaging is an alternative to model selection for dealing with model uncertainty, which is widely used and very valuable. However, most of the existing model averaging methods are proposed based on the least squares loss function,…

Methodology · Statistics 2019-10-29 Miaomiao Wang , Guohua Zou

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

Model averaging (MA) and ensembling play a crucial role in statistical and machine learning practice. When multiple candidate models are considered, MA techniques can be used to weight and combine them, often resulting in improved…

Statistics Theory · Mathematics 2025-05-06 Jingfu Peng

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng

In federated learning, differences in the data or objectives between the participating nodes motivate approaches to train a personalized machine learning model for each node. One such approach is weighted averaging between a locally trained…

Machine Learning · Computer Science 2021-10-26 Felix Grimberg , Mary-Anne Hartley , Sai P. Karimireddy , Martin Jaggi

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach learns a conditional generative model separately for each…

Machine Learning · Statistics 2026-02-03 Yikun Zhang , Steven Wilkins-Reeves , Wesley Lee , Aude Hofleitner
‹ Prev 1 2 3 10 Next ›