English
Related papers

Related papers: Optimal ridge regularization revisited

200 papers

We propose new model selection criteria based on generalized ridge estimators dominating the maximum likelihood estimator under the squared risk and the Kullback-Leibler risk in multivariate linear regression. Our model selection criteria…

Statistics Theory · Mathematics 2016-04-08 Yuichi Mori , Taiji Suzuki

Overdetermined systems of first kind integral equations appear in many applications. When the right-hand side is discretized, the resulting finite-data problem is ill-posed and admits infinitely many solutions. We propose a numerical method…

Numerical Analysis · Mathematics 2023-07-26 Patricia Díaz de Alba , Luisa Fermo , Federica Pes , Giuseppe Rodriguez

Recent theoretical studies illustrated that kernel ridgeless regression can guarantee good generalization ability without an explicit regularization. In this paper, we investigate the statistical properties of ridgeless regression with…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Yingying Zhang

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

Conventional regularization is designed to control variance, but in small-data regression it can also aggravate underfitting when predictive signal is concentrated in weak directions of a restricted representation. We study a…

Machine Learning · Computer Science 2026-04-21 Dongseok Kim , Gisung Oh

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

Building prediction models from mass-spectrometry data is challenging due to the abundance of correlated features with varying degrees of zero-inflation, leading to a common interest in reducing the features to a concise predictor set with…

Methodology · Statistics 2024-02-06 Mariella Gregorich , Michael Kammer , Harald Mischak , Georg Heinze

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

Machine Learning · Statistics 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Inexpensive surrogates are useful for reducing the cost of science and engineering studies involving large-scale, complex computational models with many input parameters. A ridge approximation is one class of surrogate that models a…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson , Paul G. Constantine

Ridge estimators regularize the squared Euclidean lengths of parameters. Such estimators are mathematically and computationally attractive but involve tuning parameters that can be difficult to calibrate. In this paper, we show that ridge…

Methodology · Statistics 2020-02-28 Shih-Ting Huang , Fang Xie , Johannes Lederer

A basis expansion with regularization methods is much appealing to the flexible or robust nonlinear regression models for data with complex structures. When the underlying function has inhomogeneous smoothness, it is well known that…

Methodology · Statistics 2021-02-02 Daeju Kim , Shuichi Kawano , Yoshiyuki Ninomiya

We consider the robust estimation of the parameters of multivariate Gaussian linear regression models. To this aim we consider robust version of the usual (Mahalanobis) least-square criterion, with or without Ridge regularization. We…

Statistics Theory · Mathematics 2025-10-13 Antoine Godichon-Baggioni , Stephane S. Robin , Laure Sansonnet

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

We consider the prediction error of linear regression with L1 regularization when the number of covariates p is large relative to the sample size n. When the model is k-sparse and well-specified, and restricted isometry or similar…

Statistics Theory · Mathematics 2011-08-02 Rina Foygel , Nathan Srebro

Regularized regression techniques for linear regression have been created the last few ten years to reduce the flaws of ordinary least squares regression with regard to prediction accuracy. In this paper, new methods for using regularized…

Machine Learning · Computer Science 2013-12-13 Doreswamy , Chanabasayya . M. Vastrad

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

Ensemble methods that average over a collection of independent predictors that are each limited to a subsampling of both the examples and features of the training data command a significant presence in machine learning, such as the…

Machine Learning · Statistics 2020-03-26 Daniel LeJeune , Hamid Javadi , Richard G. Baraniuk

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

Kernel ridge regression, in general, is expensive in memory allocation and computation time. This paper addresses low rank approximations and surrogates for kernel ridge regression, which bridge these difficulties. The fundamental…

Machine Learning · Statistics 2025-01-07 Paul Dommel