English
Related papers

Related papers: Shrinkage to Infinity: Reducing Test Error by Infl…

200 papers

Interpolation models are critical for a wide range of applications, from numerical optimization to artificial intelligence. The reliability of the provided interpolated value is of utmost importance, and it is crucial to avoid the…

Numerical Analysis · Mathematics 2023-08-15 Daniele Peri

Many statistical problems can be reduced to a linear inverse problem in which only a noisy version of the operator is available. Particular examples include random design regression, deconvolution problem, instrumental variable regression,…

Statistics Theory · Mathematics 2025-04-22 Vladimir Spokoiny

Traditional inference in cointegrating regressions requires tuning parameter choices to estimate a long-run variance parameter. Even in case these choices are "optimal", the tests are severely size distorted. We propose a novel…

Econometrics · Economics 2025-10-10 Karsten Reichold , Carsten Jentsch

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

We study the behavior of high-dimensional robust regression estimators in the asymptotic regime where $p/n$ tends to a finite non-zero limit. More specifically, we study ridge-regularized estimators, i.e…

Statistics Theory · Mathematics 2013-11-12 Noureddine El Karoui

We consider the linear model $\mathbf{y} = \mathbf{X} \mathbf{\beta}_\star + \mathbf{\epsilon}$ with $\mathbf{X}\in \mathbb{R}^{n\times p}$ in the overparameterized regime $p>n$. We estimate $\mathbf{\beta}_\star$ via generalized (weighted)…

Machine Learning · Statistics 2020-11-04 Denny Wu , Ji Xu

A fundamental problem in multivariate analysis is testing general linear hypotheses for regression coefficients in a multivariate linear model. This framework encompasses a wide range of well-studied tasks, including MANOVA, joint…

Methodology · Statistics 2025-07-09 Haoran Li

We tackle covariance estimation in low-sample scenarios, employing a structured covariance matrix with shrinkage methods. These involve convexly combining a low-bias/high-variance empirical estimate with a biased regularization estimator,…

Instrumentation and Methods for Astrophysics · Physics 2024-06-28 Olivier Flasseur , Eric Thiébaut , Loïc Denis , Maud Langlois

From benign overfitting in overparameterized models to rich power-law scalings in performance, simple ridge regression displays surprising behaviors sometimes thought to be limited to deep neural networks. This balance of phenomenological…

Machine Learning · Statistics 2026-05-08 Alexander Atanasov , Jacob A. Zavatone-Veth , Cengiz Pehlevan

In this study, we propose shrinkage methods based on {\it generalized ridge regression} (GRR) estimation which is suitable for both multicollinearity and high dimensional problems with small number of samples (large $p$, small $n$). Also,…

Statistics Theory · Mathematics 2020-03-04 Bahadır Yüzbaşı , Mohammad Arashi , S. Ejaz Ahmed

Interpolators -- estimators that achieve zero training error -- have attracted growing attention in machine learning, mainly because state-of-the art neural networks appear to be models of this type. In this paper, we study minimum $\ell_2$…

Statistics Theory · Mathematics 2022-09-12 Trevor Hastie , Andrea Montanari , Saharon Rosset , Ryan J. Tibshirani

Understanding generalization and estimation error of estimators for simple models such as linear and generalized linear models has attracted a lot of attention recently. This is in part due to an interesting observation made in machine…

Machine Learning · Statistics 2021-03-09 Mojtaba Sahraee-Ardakan , Tung Mai , Anup Rao , Ryan Rossi , Sundeep Rangan , Alyson K. Fletcher

In this paper we study the asymptotics of linear regression in settings with non-Gaussian covariates where the covariates exhibit a linear dependency structure, departing from the standard assumption of independence. We model the covariates…

Machine Learning · Statistics 2024-12-10 Behrad Moniri , Hamed Hassani

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

The inference performance of the pseudolikelihood method is discussed in the framework of the inverse Ising problem when the $\ell_2$-regularized (ridge) linear regression is adopted. This setup is introduced for theoretically investigating…

Disordered Systems and Neural Networks · Physics 2021-10-19 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

Many statistical applications require an estimate of a covariance matrix and/or its inverse. When the matrix dimension is large compared to the sample size, which happens frequently, the sample covariance matrix is known to perform poorly…

Statistics Theory · Mathematics 2012-07-24 Olivier Ledoit , Michael Wolf

We study the generalization error of functions that interpolate prescribed data points and are selected by minimizing a weighted norm. Under natural and general conditions, we prove that both the interpolants and their generalization errors…

Numerical Analysis · Mathematics 2021-02-11 Weilin Li

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

We present the first optimal rates for infinite-dimensional vector-valued ridge regression on a continuous scale of norms that interpolate between $L_2$ and the hypothesis space, which we consider as a vector-valued reproducing kernel…

Machine Learning · Statistics 2024-08-07 Zhu Li , Dimitri Meunier , Mattes Mollenhauer , Arthur Gretton

Recent empirical and theoretical studies have shown that many learning algorithms -- from linear regression to neural networks -- can have test performance that is non-monotonic in quantities such the sample size and model size. This…

Machine Learning · Computer Science 2021-04-30 Preetum Nakkiran , Prayaag Venkat , Sham Kakade , Tengyu Ma