中文
相关论文

相关论文: Transfer Learning for High-dimensional Linear Regr…

200 篇论文

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

机器学习 · 统计学 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Transfer learning is essential when sufficient data comes from the source domain, with scarce labeled data from the target domain. We develop estimators that achieve minimax linear risk for linear regression problems under distribution…

机器学习 · 计算机科学 2021-06-24 Qi Lei , Wei Hu , Jason D. Lee

From the nano-scale to the macro-scale, biological tissue is spatially heterogeneous. Even when tissue behavior is well understood, the exact subject specific spatial distribution of material properties is often unknown. And, when…

组织与器官 · 定量生物学 2020-11-02 Emma Lejeune , Bill Zhao

In a variety of business situations, the introduction or improvement of machine learning approaches is impaired as these cannot draw on existing analytical models. However, in many cases similar problems may have already been solved…

机器学习 · 计算机科学 2020-05-22 Robin Hirt , Niklas Kühl , Yusuf Peker , Gerhard Satzger

A key element in transfer learning is representation learning; if representations can be developed that expose the relevant factors underlying the data, then new tasks and domains can be learned readily based on mappings of these salient…

机器学习 · 计算机科学 2014-12-18 Yujia Li , Kevin Swersky , Richard Zemel

The traditional paradigm for developing machine prognostics usually relies on generalization from data acquired in experiments under controlled conditions prior to deployment of the equipment. Detecting or predicting failures and estimating…

机器学习 · 计算机科学 2019-10-02 Yuantao Fan , Sławomir Nowaczyk , Thorsteinn Rögnvaldsson

Transfer learning refers to the promising idea of initializing model fits based on pre-training on other data. We particularly consider regression modeling settings where parameter estimates from previous data can be used as anchoring…

统计方法学 · 统计学 2020-07-07 Wessel N. van Wieringen , Harald Binder

We consider the transfer learning problem in the high dimensional linear regression setting, where the feature dimension is larger than the sample size. To learn transferable information, which may vary across features or the source…

机器学习 · 统计学 2024-11-26 Zelin He , Ying Sun , Jingyuan Liu , Runze Li

Existing high-dimensional statistical methods are largely established for analyzing individual-level data. In this work, we study estimation and inference for high-dimensional linear models where we only observe "proxy data", which include…

统计方法学 · 统计学 2022-01-12 Sai Li , T. Tony Cai , Hongzhe Li

High-dimensional prediction typically comprises two steps: variable selection and subsequent least-squares refitting on the selected variables. However, the standard variable selection procedures, such as the lasso, hinge on tuning…

统计方法学 · 统计学 2017-06-07 Didier Chételat , Johannes Lederer , Joseph Salmon

Transfer learning with a small amount of target data is an effective and common approach to adapting a pre-trained model to distribution shifts. In some situations, target data labels may be expensive to obtain, so we may only have access…

机器学习 · 计算机科学 2023-05-26 Annie S. Chen , Yoonho Lee , Amrith Setlur , Sergey Levine , Chelsea Finn

Transfer learning is a promising method for AOI applications since it can significantly shorten sample collection time and improve efficiency in today's smart manufacturing. However, related research enhanced the network models by applying…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Erik Isai Valle Salgado , Haoxin Yan , Yue Hong , Peiyuan Zhu , Shidong Zhu , Chengwei Liao , Yanxiang Wen , Xiu Li , Xiang Qian , Xiaohao Wang , Xinghui Li

Graphon models provide a flexible nonparametric framework for estimating latent connectivity probabilities in networks, enabling a range of downstream applications such as link prediction and data augmentation. However, accurate graphon…

机器学习 · 计算机科学 2025-10-28 Yuyao Wang , Yu-Hung Cheng , Debarghya Mukherjee , Huimin Cheng

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

机器学习 · 统计学 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

In this paper, we explore the knowledge transfer under the setting of matrix completion, which aims to enhance the estimation of a low-rank target matrix with auxiliary data available. We propose a transfer learning procedure given prior…

机器学习 · 统计学 2025-07-04 Dali Liu , Haolei Weng

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

机器学习 · 计算机科学 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

计算与语言 · 计算机科学 2015-11-20 Dong Wang , Thomas Fang Zheng

Ridge regression with random coefficients provides an important alternative to fixed coefficients regression in high dimensional setting when the effects are expected to be small but not zeros. This paper considers estimation and prediction…

机器学习 · 统计学 2023-06-29 Hongzhe Zhang , Hongzhe Li

We introduce the localized Lasso, which is suited for learning models that are both interpretable and have a high predictive power in problems with high dimensionality $d$ and small sample size $n$. More specifically, we consider a function…

机器学习 · 统计学 2016-10-17 Makoto Yamada , Koh Takeuchi , Tomoharu Iwata , John Shawe-Taylor , Samuel Kaski

Link prediction in multilayer networks is a key challenge in applications such as recommendation systems and protein-protein interaction prediction. While many techniques have been developed, most rely on assumptions about shared structures…

机器学习 · 统计学 2025-06-17 Yongqin Qiu , Xinyu Zhang