English
Related papers

Related papers: Shrinkage to Infinity: Reducing Test Error by Infl…

200 papers

We study the consistency of minimum-norm interpolation in reproducing kernel Hilbert spaces corresponding to bounded kernels. Our main result give lower bounds for the generalization error of the kernel interpolation measured in a…

Machine Learning · Statistics 2025-09-30 Yunfei Yang

In this paper, we study norm-based regularization methods for neural networks. We compare existing penalization approaches and introduce two regularization strategies that extend classical ridge- and lasso-type penalties to neural network…

Machine Learning · Statistics 2026-05-04 Muhammad Qasim , Farrukh Javed

High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important…

Methodology · Statistics 2016-05-12 Zemin Zheng , Yingying Fan , Jinchi Lv

Ridge regression (RR) is a regularization technique that penalizes the L2-norm of the coefficients in linear regression. One of the challenges of using RR is the need to set a hyperparameter ($\alpha$) that controls the amount of…

Methodology · Statistics 2020-05-08 Ariel Rokem , Kendrick Kay

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

Statistics Theory · Mathematics 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

Selecting appropriate regularization coefficients is critical to performance with respect to regularized empirical risk minimization problems. Existing theoretical approaches attempt to determine the coefficients in order for regularized…

Machine Learning · Computer Science 2019-09-05 Akihiro Yabe , Takanori Maehara

In this work, we study the positive definiteness (PDness) problem in covariance matrix estimation. For high dimensional data, many regularized estimators are proposed under structural assumptions on the true covariance matrix including…

Methodology · Statistics 2019-04-16 Young-Geun Choi , Johan Lim , Anindya Roy , Junyong Park

We consider the problem of inference for projection parameters in linear regression with increasing dimensions. This problem has been studied under a variety of assumptions in the literature. The classical asymptotic normality result for…

Statistics Theory · Mathematics 2024-01-12 Woonyoung Chang , Arun Kumar Kuchibhotla , Alessandro Rinaldo

We are interested in testing general linear hypotheses in a high-dimensional multivariate linear regression model. The framework includes many well-studied problems such as two-sample tests for equality of population means, MANOVA and…

Methodology · Statistics 2018-10-05 Haoran Li , Alexander Aue , Debashis Paul

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a…

Machine Learning · Statistics 2024-06-06 Yihang Chen , Fanghui Liu , Taiji Suzuki , Volkan Cevher

Iterative regularization is a classic idea in regularization theory, that has recently become popular in machine learning. On the one hand, it allows to design efficient algorithms controlling at the same time numerical and statistical…

Machine Learning · Statistics 2024-10-10 Vassilis Apidopoulos , Tomaso Poggio , Lorenzo Rosasco , Silvia Villa

We consider the problem of finding tuned regularized parameter estimators for linear models. We start by showing that three known optimal linear estimators belong to a wider class of estimators that can be formulated as a solution to a…

Statistics Theory · Mathematics 2023-05-03 Per Mattsson , Dave Zachariah , Petre Stoica

Cross-correlation techniques provide a promising avenue for calibrating photometric redshifts and determining redshift distributions using spectroscopy which is systematically incomplete (e.g., current deep spectroscopic surveys fail to…

Instrumentation and Methods for Astrophysics · Physics 2012-01-20 Daniel J. Matthews , Jeffrey A. Newman

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

Methodology · Statistics 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

Subsampling is a popular approach to alleviating the computational burden for analyzing massive datasets. Recent efforts have been devoted to various statistical models without explicit regularization. In this paper, we develop an efficient…

Methodology · Statistics 2022-04-12 Yunlu Chen , Nan Zhang

Data augmentation is a powerful technique to improve performance in applications such as image and text classification tasks. Yet, there is little rigorous understanding of why and how various augmentations work. In this work, we consider a…

Machine Learning · Computer Science 2023-07-28 Sen Wu , Hongyang R. Zhang , Gregory Valiant , Christopher Ré

We consider prediction with expert advice when data are generated from distributions varying arbitrarily within an unknown constraint set. This semi-adversarial setting includes (at the extremes) the classical i.i.d. setting, when the…

Machine Learning · Statistics 2022-07-25 Blair Bilodeau , Jeffrey Negrea , Daniel M. Roy

We study the implicit regularization of mini-batch stochastic gradient descent, when applied to the fundamental problem of least squares regression. We leverage a continuous-time stochastic differential equation having the same moments as…

Machine Learning · Statistics 2020-06-23 Alnur Ali , Edgar Dobriban , Ryan J. Tibshirani
‹ Prev 1 4 5 6 7 8 10 Next ›