English
Related papers

Related papers: Cross validation in LASSO and its acceleration

200 papers

For a large class of regularized models, leave-one-out cross-validation can be efficiently estimated with an approximate leave-one-out formula (ALO). We consider the problem of adjusting hyperparameters so as to optimize ALO. We derive…

Machine Learning · Statistics 2020-11-23 Ryan Burn

We consider the parametric learning problem, where the objective of the learner is determined by a parametric loss function. Employing empirical risk minimization with possibly regularization, the inferred parameter vector will be biased…

Machine Learning · Statistics 2017-11-16 Ahmad Beirami , Meisam Razaviyayn , Shahin Shahrampour , Vahid Tarokh

The selection of Gaussian kernel parameters plays an important role in the applications of support vector classification (SVC). A commonly used method is the k-fold cross validation with grid search (CV), which is extremely time-consuming…

Machine Learning · Computer Science 2025-01-22 Linkai Luo , Qiaoling Yang , Hong Peng , Yiding Wang , Ziyang Chen

When evaluating and comparing models using leave-one-out cross-validation (LOO-CV), the uncertainty of the estimate is typically assessed using the variance of the sampling distribution. Considering the uncertainty is important, as the…

Methodology · Statistics 2022-02-16 Tuomas Sivula , Måns Magnusson , Aki Vehtari

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

Machine Learning · Statistics 2026-01-05 Bin Luo , Susan Halabi

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

Statistics Theory · Mathematics 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

We propose a rescaled LASSO, by premultipying the LASSO with a matrix term, namely linear unified LASSO (LLASSO) for multicollinear situations. Our numerical study has shown that the LLASSO is comparable with other sparse modeling…

Methodology · Statistics 2017-10-16 M. Arashi , Y. Asar , B. Yuzbasi

Cross-validation is one of the most popular model selection methods in statistics and machine learning. Despite its wide applicability, traditional cross validation methods tend to select overfitting models, due to the ignorance of the…

Methodology · Statistics 2017-12-25 Jing Lei

Zero-inflated explanatory variables are common in fields such as ecology and finance. In this paper we address the problem of having excess of zero values in some explanatory variables which are subject to multioutcome lasso-regularized…

Methodology · Statistics 2021-09-13 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

Maximum likelihood estimation of large Markov-switching vector autoregressions (MS-VARs) can be challenging or infeasible due to parameter proliferation. To accommodate situations where dimensionality may be of comparable order to or…

Econometrics · Economics 2021-07-28 Kenwin Maung

We propose MC+, a fast, continuous, nearly unbiased and accurate method of penalized variable selection in high-dimensional linear regression. The LASSO is fast and continuous, but biased. The bias of the LASSO may prevent consistent…

Statistics Theory · Mathematics 2010-02-26 Cun-Hui Zhang

We generalize fast Gaussian process leave-one-out formulae to multiple-fold cross-validation, highlighting in turn the covariance structure of cross-validation residuals in both Simple and Universal Kriging frameworks. We illustrate how…

Methodology · Statistics 2023-06-06 David Ginsbourger , Cedric Schärer

Graphical models are frequently used to explore networks, such as genetic networks, among a set of variables. This is usually carried out via exploring the sparsity of the precision matrix of the variables under consideration. Penalized…

Applications · Statistics 2009-08-17 Jianqing Fan , Yang Feng , Yichao Wu

Modern variable selection procedures make use of penalization methods to execute simultaneous model selection and estimation. A popular method is the LASSO (least absolute shrinkage and selection operator), the use of which requires…

Methodology · Statistics 2023-01-12 Meadhbh O'Neill , Kevin Burke

We study prediction intervals based on leave-one-out residuals in a linear regression model where the number of explanatory variables can be large compared to sample size. We establish uniform asymptotic validity (conditional on the…

Statistics Theory · Mathematics 2016-02-19 Lukas Steinberger , Hannes Leeb

The present work aims at deriving theoretical guaranties on the behavior of some cross-validation procedures applied to the $k$-nearest neighbors ($k$NN) rule in the context of binary classification. Here we focus on the leave-$p$-out…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Tristan Mary-Huard

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been…

Methodology · Statistics 2025-11-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

Cross-validation (CV) is widely used for tuning a model with respect to user-selected parameters and for selecting a "best" model. For example, the method of $k$-nearest neighbors requires the user to choose $k$, the number of neighbors,…

Applications · Statistics 2012-03-01 Hui Shen , William J. Welch , Jacqueline M. Hughes-Oliver

We consider the problem of selective inference after solving a (randomized) convex statistical learning program in the form of a penalized or constrained loss function. Our first main result is a change-of-measure formula that describes…

Statistics Theory · Mathematics 2016-09-20 Xiaoying Tian Harris , Snigdha Panigrahi , Jelena Markovic , Nan Bi , Jonathan Taylor

In this article we study variable selection problem using LASSO with new improvisations. LASSO uses $\ell_{1}$ penalty, it shrinks most of the coefficients to zero when number of explanatory variables $(p)$ are much larger the number of…

Applications · Statistics 2017-05-19 Ashutosh K. Maurya