English
Related papers

Related papers: Ridge-Regularized Largest Root Test For High-Dimen…

200 papers

The generalized Ridge penalty is a powerful tool for dealing with overfitting and for high-dimensional regressions. The generalized Ridge regression can be derived as the mean of a posterior distribution with a Normal prior and a given…

Methodology · Statistics 2022-08-10 Said Obakrim , Pierre Ailliot , Valérie Monbet , Nicolas Raillard

This paper considers testing the covariance matrices structure based on Wald's score test in large dimensional setting. The hypothesis $H_0: \Sigma =\Sigma_0 $ for a given matrix $\Sigma_0$, which covers the identity hypothesis test and…

Methodology · Statistics 2016-03-01 Dandan Jiang , QiBin Zhang

In this work we investigate the generalization performance of random feature ridge regression (RFRR). Our main contribution is a general deterministic equivalent for the test error of RFRR. Specifically, under a certain concentration…

Machine Learning · Statistics 2024-11-06 Leonardo Defilippis , Bruno Loureiro , Theodor Misiakiewicz

Ridge leverage scores provide a balance between low-rank approximation and regularization, and are ubiquitous in randomized linear algebra and machine learning. Deterministic algorithms are also of interest in the moderately big data…

Statistics Theory · Mathematics 2018-12-27 Shannon R. McCurdy

In many applications, linear models fit the data poorly. This article studies an appealing alternative, the generalized regression model. This model only assumes that there exists an unknown monotonically increasing link function connecting…

Methodology · Statistics 2017-07-24 Fang Han , Hongkai Ji , Zhicheng Ji , Honglang Wang

We consider the problem of jointly estimating multiple inverse covariance matrices from high-dimensional data consisting of distinct classes. An $\ell_2$-penalized maximum likelihood approach is employed. The suggested approach is flexible…

This study examines generalized cross-validation for the tuning parameter selection for ridge regression in high-dimensional misspecified linear models. The set of candidates for the tuning parameter includes not only positive values but…

Statistics Theory · Mathematics 2026-01-21 Akira Shinkyu

Maximum likelihood estimation in nonlinear models can exhibit substantial instability in finite samples when the data provide limited information about certain parameters. Such instability is driven by rare but extreme realizations of the…

Methodology · Statistics 2026-04-15 Masamune Iwasawa

Researchers are often interested in drawing inferences regarding the order between two experimental groups on the basis of multivariate response data. Since standard multivariate methods are designed for two-sided alternatives, they may not…

Statistics Theory · Mathematics 2013-03-11 Ori Davidov , Shyamal Peddada

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

Machine Learning · Computer Science 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

Under certain conditions, the largest eigenvalue of a sample covariance matrix undergoes a well-known phase transition when the sample size $n$ and data dimension $p$ diverge proportionally. In the subcritical regime, this eigenvalue has…

Statistics Theory · Mathematics 2025-04-01 Nina Dörnemann , Miles E. Lopes

Random Feature (RF) models are used as efficient parametric approximations of kernel methods. We investigate, by means of random matrix theory, the connection between Gaussian RF models and Kernel Ridge Regression (KRR). For a Gaussian RF…

Machine Learning · Statistics 2020-09-24 Arthur Jacot , Berfin Şimşek , Francesco Spadaro , Clément Hongler , Franck Gabriel

Regression models usually tend to recover a noisy signal in the form of a combination of regressors, also called features in machine learning, themselves being the result of a learning process.The alignment of the prior covariance feature…

Statistical Mechanics · Physics 2023-01-25 Cyril Furtlehner

An important unresolved challenge in the theory of regularization is to set the regularization coefficients of popular techniques like the ElasticNet with general provable guarantees. We consider the problem of tuning the regularization…

Machine Learning · Computer Science 2024-01-17 Maria-Florina Balcan , Mikhail Khodak , Dravyansh Sharma , Ameet Talwalkar

Inference of instrumental variable regression models with many weak instruments attracts many attentions recently. To extend the classical Anderson-Rubin test to high-dimensional setting, many procedures adopt ridge-regularization. However,…

Methodology · Statistics 2025-04-30 Jiarong Ding , Xu Guo , Yanmei Shi , Yuxin Wang

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

We study a ridge estimator for the high-dimensional two-way fixed effect regression model with a sparse bipartite network. We develop concentration inequalities showing that when the ridge parameters increase as the log of the network size,…

Econometrics · Economics 2026-01-08 Junnan He , Jean-Marc Robin

The greatest root distribution occurs everywhere in classical multivariate analysis, but even under the null hypothesis the exact distribution has required extensive tables or special purpose software. We describe a simple approximation,…

Applications · Statistics 2010-09-30 Iain M. Johnstone

We consider fully row/column-correlated linear regression models and study several classical estimators (including minimum norm interpolators (GLS), ordinary least squares (LS), and ridge regressors). We show that \emph{Random Duality…

Machine Learning · Statistics 2024-06-14 Mihailo Stojnic

In this paper, we propose the Graph-Fused Multivariate Regression (GFMR) via Total Variation regularization, a novel method for estimating the association between a one-dimensional or multidimensional array outcome and scalar predictors.…

Methodology · Statistics 2020-01-15 Ying Liu , Bowei Yan , Kathleen Merikangas , Haochang Shou