English
Related papers

Related papers: Risk and cross validation in ridge regression with…

200 papers

This paper studies transfer learning for ridge-regularized robust linear regression in the moderate-dimensional regime, where the number of predictors is of the same order as the sample size and the regression coefficients are not assumed…

Methodology · Statistics 2026-04-14 Lingfeng Lyu , Xiao Guo , Zongqi Liu

We present a methodology for model evaluation and selection where the sampling mechanism violates the i.i.d. assumption. Our methodology involves a formulation of the bias between the standard Cross-Validation (CV) estimator and the mean…

Methodology · Statistics 2025-03-14 Oren Yuval , Saharon Rosset

For high-dimensional linear regression models, we review and compare several estimators of variances $\tau^2$ and $\sigma^2$ of the random slopes and errors, respectively. These variances relate directly to ridge regression penalty…

Computation · Statistics 2019-02-08 Jurre R. Veerman , Gwenael G. R. Leday , Mark A. van de Wiel

Recently, deep neural networks have been found to nearly interpolate training data but still generalize well in various applications. To help understand such a phenomenon, it has been of interest to analyze the ridge estimator and its…

Statistics Theory · Mathematics 2024-05-03 Libin Liang , Zhiqiang Tan

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do…

Methodology · Statistics 2016-06-17 Wessel N. van Wieringen , Carel F. W. Peeters

We introduce a regularized Generalized Covariance (RGCov) estimator as an extension of the GCov estimator to high dimensional setting that results either from high-dimensional data or a large number of nonlinear transformations used in the…

Econometrics · Economics 2025-04-29 Francesco Giancaterini , Alain Hecq , Joann Jasiak , Aryan Manafi Neyazi

In machine learning, statistics, econometrics and statistical physics, cross-validation (CV) is used asa standard approach in quantifying the generalisation performance of a statistical model. A directapplication of CV in time-series leads…

Machine Learning · Statistics 2021-12-14 Mehmet Süzen , Alper Yegenoglu

From benign overfitting in overparameterized models to rich power-law scalings in performance, simple ridge regression displays surprising behaviors sometimes thought to be limited to deep neural networks. This balance of phenomenological…

Machine Learning · Statistics 2026-05-08 Alexander Atanasov , Jacob A. Zavatone-Veth , Cengiz Pehlevan

This paper provides a comprehensive error analysis of learning with vector-valued random features (RF). The theory is developed for RF ridge regression in a fully general infinite-dimensional input-output setting, but nonetheless applies to…

Machine Learning · Statistics 2024-05-24 Samuel Lanthaler , Nicholas H. Nelsen

Marginal association summary statistics have attracted great attention in statistical genetics, mainly because the primary results of most genome-wide association studies (GWAS) are produced by marginal screening. In this paper, we study…

Methodology · Statistics 2019-11-25 Bingxin Zhao , Hongtu Zhu

Random feature ridge regression is often analyzed in the high-dimensional regime under the homogeneous sampling model $x_i=\Sigma^{1/2}x_i'$, where the vectors $x_i'$ have iid entries and the same covariance matrix $\Sigma$ is shared by all…

Machine Learning · Statistics 2026-05-19 Issa-Mbenard Dabo , Jérémie Bigot

Ridge regression with random coefficients provides an important alternative to fixed coefficients regression in high dimensional setting when the effects are expected to be small but not zeros. This paper considers estimation and prediction…

Machine Learning · Statistics 2023-06-29 Hongzhe Zhang , Hongzhe Li

We derive high-dimensional Gaussian comparison results for the standard $V$-fold cross-validated risk estimates. Our results combine a recent stability-based argument for the low-dimensional central limit theorem of cross-validation with…

Statistics Theory · Mathematics 2023-11-15 Nicholas Kissel , Jing Lei

General ridge estimators are widely used in the general linear model because they possess desirable properties such as linear sufficiency and linear admissibility. However, when the covariance matrix of the error term is partially unknown,…

Statistics Theory · Mathematics 2026-01-27 Hirai Mukasa

This article provides, through theoretical analysis, an in-depth understanding of the classification performance of the empirical risk minimization framework, in both ridge-regularized and unregularized cases, when high dimensional data are…

Machine Learning · Statistics 2020-11-26 Xiaoyi Mai , Zhenyu Liao

We consider learning an unknown target function $f_*$ using kernel ridge regression (KRR) given i.i.d. data $(u_i,y_i)$, $i\leq n$, where $u_i \in U$ is a covariate vector and $y_i = f_* (u_i) +\varepsilon_i \in \mathbb{R}$. A recent string…

Machine Learning · Statistics 2024-03-15 Theodor Misiakiewicz , Basil Saeed

Because of the advance in technologies, modern statistical studies often encounter linear models with the number of explanatory variables much larger than the sample size. Estimation and variable selection in these high-dimensional problems…

Statistics Theory · Mathematics 2012-06-06 Jun Shao , Xinwei Deng

Cross-correlation techniques provide a promising avenue for calibrating photometric redshifts and determining redshift distributions using spectroscopy which is systematically incomplete (e.g., current deep spectroscopic surveys fail to…

Instrumentation and Methods for Astrophysics · Physics 2012-01-20 Daniel J. Matthews , Jeffrey A. Newman

Ridge regression is a well established regression estimator which can conveniently be adapted for classification problems. One compelling reason is probably the fact that ridge regression emits a closed-form solution thereby facilitating…

Machine Learning · Computer Science 2020-03-26 Jakramate Bootkrajang

Cross validation is widely used for selecting tuning parameters in regularization methods, but it is computationally intensive in general. To lessen its computational burden, approximation schemes such as generalized approximate cross…

Methodology · Statistics 2024-12-02 Shanshan Tu , Yunzhang Zhu , Yoonkyung Lee , Qiuyu Gu , Haozhen Yu