English
Related papers

Related papers: Shrinkage to Infinity: Reducing Test Error by Infl…

200 papers

This article provides, through theoretical analysis, an in-depth understanding of the classification performance of the empirical risk minimization framework, in both ridge-regularized and unregularized cases, when high dimensional data are…

Machine Learning · Statistics 2020-11-26 Xiaoyi Mai , Zhenyu Liao

Regularization for optimization is a crucial technique to avoid overfitting in machine learning. In order to obtain the best performance, we usually train a model by tuning the regularization parameters. It becomes costly, however, when a…

Machine Learning · Computer Science 2020-08-18 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

Shrinkage estimators of covariance are an important tool in modern applied and theoretical statistics. They play a key role in regularized estimation problems, such as ridge regression (aka Tykhonov regularization), regularized discriminant…

Statistics Theory · Mathematics 2011-05-10 Noureddine El Karoui , Holger Koesters

The objective of this work is to propose an asymptotic correction method for the estimators of parameters from regression models with covariates subject to classification errors. A correction was developed based on the least squares…

Methodology · Statistics 2025-07-11 Alexandre Garcia Dias , Mariana Rodrigues Motta , Alexandre Hild Aono

Many common estimators in machine learning and causal inference are linear smoothers, where the prediction is a weighted average of the training outcomes. Some estimators, such as ordinary least squares and kernel ridge regression, allow…

Machine Learning · Computer Science 2026-04-02 David Arbour , Harsh Parikh , Bijan Niknam , Elizabeth Stuart , Kara Rudolph , Avi Feller

Modern computational models in supervised machine learning are often highly parameterized universal approximators. As such, the value of the parameters is unimportant, and only the out of sample performance is considered. On the other hand…

Computation · Statistics 2021-11-04 Matthew Dixon , Tyler Ward

Deep neural networks generalize well despite being exceedingly overparameterized and being trained without explicit regularization. This curious phenomenon has inspired extensive research activity in establishing its statistical principles:…

Machine Learning · Statistics 2021-09-16 Ke Wang , Christos Thrampoulidis

Maximum likelihood estimation in nonlinear models can exhibit substantial instability in finite samples when the data provide limited information about certain parameters. Such instability is driven by rare but extreme realizations of the…

Methodology · Statistics 2026-04-15 Masamune Iwasawa

We study matrix sketching methods for regularized variants of linear regression, low rank approximation, and canonical correlation analysis. Our main focus is on sketching techniques which preserve the objective function value for…

Data Structures and Algorithms · Computer Science 2017-06-27 Haim Avron , Kenneth L. Clarkson , David P. Woodruff

Linear discriminant analysis (LDA) is a widely used technique for data classification. The method offers adequate performance in many classification problems, but it becomes inefficient when the data covariance matrix is ill-conditioned.…

Machine Learning · Statistics 2024-02-08 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid M. Al-Saggaf

Regularization aims to improve prediction performance of a given statistical modeling approach by moving to a second approach which achieves worse training error but is expected to have fewer degrees of freedom, i.e., better agreement…

Statistics Theory · Mathematics 2013-11-13 Shachar Kaufman , Saharon Rosset

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Kernel ridge regression is an important nonparametric method for estimating smooth functions. We introduce a new set of conditions, under which the actual rates of convergence of the kernel ridge regression estimator under both the L_2 norm…

Statistics Theory · Mathematics 2020-01-03 Rui Tuo , Yan Wang , C. F. Jeff Wu

In this work, we investigate the behavior of ridge regression in an overparameterized binary classification task. We assume examples are drawn from (anisotropic) class-conditional cluster distributions with opposing means and we allow for…

Machine Learning · Statistics 2025-03-12 Alexander Tsigler , Luiz F. O. Chamon , Spencer Frei , Peter L. Bartlett

Inference of instrumental variable regression models with many weak instruments attracts many attentions recently. To extend the classical Anderson-Rubin test to high-dimensional setting, many procedures adopt ridge-regularization. However,…

Methodology · Statistics 2025-04-30 Jiarong Ding , Xu Guo , Yanmei Shi , Yuxin Wang

We consider a commonly studied supervised classification of a synthetic dataset whose labels are generated by feeding a one-layer neural network with random iid inputs. We study the generalization performances of standard classifiers in the…

Machine Learning · Statistics 2021-02-18 Benjamin Aubin , Florent Krzakala , Yue M. Lu , Lenka Zdeborová

Conventional regularization is designed to control variance, but in small-data regression it can also aggravate underfitting when predictive signal is concentrated in weak directions of a restricted representation. We study a…

Machine Learning · Computer Science 2026-04-21 Dongseok Kim , Gisung Oh

We consider the problem of estimating the slope function in a functional regression with a scalar response and a functional covariate. This central problem of functional data analysis is well known to be ill-posed, thus requiring a…

Methodology · Statistics 2016-10-05 Anirvan Chakraborty , Victor M. Panaretos

In recent years, there has been a significant growth in research focusing on minimum $\ell_2$ norm (ridgeless) interpolation least squares estimators. However, the majority of these analyses have been limited to an unrealistic regression…

Statistics Theory · Mathematics 2024-06-14 Sungyoon Lee , Sokbae Lee

This paper establishes the generalization error of pooled min-$\ell_2$-norm interpolation in transfer learning where data from diverse distributions are available. Min-norm interpolators emerge naturally as implicit regularized limits of…

Statistics Theory · Mathematics 2024-06-21 Yanke Song , Sohom Bhattacharya , Pragya Sur