English
Related papers

Related papers: Tuning-free ridge estimators for high-dimensional …

200 papers

We consider estimation of the extreme value index and extreme quantiles for heavy-tailed data that are right-censored. We study a general procedure of removing low importance observations in tail estimators. This trimming procedure is…

Statistics Theory · Mathematics 2021-05-13 Martin Bladt , Hansjoerg Albrecher , Jan Beirlant

We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions -- a Linear/Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear/Ridge…

Numerical Analysis · Mathematics 2021-07-12 Constantin Greif , Philipp Junk , Karsten Urban

We introduce the concept of coverage risk as an error measure for density ridge estimation. The coverage risk generalizes the mean integrated square error to set estimation. We propose two risk estimators for the coverage risk and we show…

Methodology · Statistics 2015-06-09 Yen-Chi Chen , Christopher R. Genovese , Shirley Ho , Larry Wasserman

The classical kernel ridge regression problem aims to find the best fit for the output $Y$ as a function of the input data $X\in \mathbb{R}^d$, with a fixed choice of regularization term imposed by a given choice of a reproducing kernel…

Machine Learning · Statistics 2025-06-10 Yang Li , Feng Ruan

Time-varying parameters (TVPs) models are frequently used in economics to capture structural change. I highlight a rather underutilized fact -- that these are actually ridge regressions. Instantly, this makes computations, tuning, and…

Econometrics · Economics 2024-11-18 Philippe Goulet Coulombe

Modern computational models in supervised machine learning are often highly parameterized universal approximators. As such, the value of the parameters is unimportant, and only the out of sample performance is considered. On the other hand…

Computation · Statistics 2021-11-04 Matthew Dixon , Tyler Ward

Shrinkage estimators of covariance are an important tool in modern applied and theoretical statistics. They play a key role in regularized estimation problems, such as ridge regression (aka Tykhonov regularization), regularized discriminant…

Statistics Theory · Mathematics 2011-05-10 Noureddine El Karoui , Holger Koesters

The generalized Ridge penalty is a powerful tool for dealing with overfitting and for high-dimensional regressions. The generalized Ridge regression can be derived as the mean of a posterior distribution with a Normal prior and a given…

Methodology · Statistics 2022-08-10 Said Obakrim , Pierre Ailliot , Valérie Monbet , Nicolas Raillard

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2017-11-15 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

Regularized models have been applied in lots of areas, with high-dimensional data sets being popular. Because tuning parameter decides the theoretical performance and computational efficiency of the regularized models, tuning parameter…

Methodology · Statistics 2024-05-14 Pan Shang , Lingchen Kong , Yiting Ma

Separation in logistic regression is a common problem causing failure of the iterative estimation process when finding maximum likelihood estimates. Firth's correction (FC) was proposed as a solution, providing estimates also in presence of…

Methodology · Statistics 2020-12-01 Hana Šinkovec , Angelika Geroldinger , Georg Heinze , Rok Blagus

This paper analyzes the estimation of econometric models by penalizing the sum of squares of the residuals with a factor that makes the model estimates approximate those that would be obtained when considering the possible simple…

Statistics Theory · Mathematics 2024-05-10 Román Salmerón Gómez , Catalina B. García García

This paper characterizes the conditional distribution properties of the finite sample ridge regression estimator and uses that result to evaluate total regression and generalization errors that incorporate the inaccuracies committed at the…

Machine Learning · Statistics 2016-05-31 Lyudmila Grigoryeva , Juan-Pablo Ortega

Reparameterization (RP) and likelihood ratio (LR) gradient estimators are used to estimate gradients of expectations throughout machine learning and reinforcement learning; however, they are usually explained as simple mathematical tricks,…

Machine Learning · Computer Science 2021-06-01 Paavo Parmas , Masashi Sugiyama

We consider unregularized robust M-estimators for linear models under Gaussian design and heavy-tailed noise, in the proportional asymptotics regime where the sample size n and the number of features p are both increasing such that $p/n \to…

Statistics Theory · Mathematics 2025-01-29 Pierre C. Bellec , Takuya Koriyama

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

We study a linear high-dimensional regression model in a semi-supervised setting, where for many observations only the vector of covariates $X$ is given with no response $Y$. We do not make any sparsity assumptions on the vector of…

Statistics Theory · Mathematics 2021-09-03 Ilan Livne , David Azriel , Yair Goldberg

New local linear estimators are proposed for a wide class of nonparametric regression models. The estimators are uniformly consistent regardless of satisfying traditional conditions of depen\-dence of design elements. The estimators are the…

Statistics Theory · Mathematics 2022-07-05 Yuliana Linke , Igor Borisov , Pavel Ruzankin , Vladimir Kutsenko , Elena Yarovaya , Svetlana Shalnova

Linearly parametrized models are widely used in control and signal processing, with the least-squares (LS) estimate being the archetypical solution. When the input is insufficiently exciting, the LS problem may be unsolvable or numerically…

Machine Learning · Statistics 2026-01-21 Szabolcs Szentpéteri , Balázs Csanád Csáji