English
Related papers

Related papers: On LASSO for High Dimensional Predictive Regressio…

200 papers

We devise a one-shot approach to distributed sparse regression in the high-dimensional setting. The key idea is to average "debiased" or "desparsified" lasso estimators. We show the approach converges at the same rate as the lasso as long…

Machine Learning · Statistics 2015-08-12 Jason D. Lee , Yuekai Sun , Qiang Liu , Jonathan E. Taylor

We present a new methodology for simultaneous variable selection and parameter estimation in function-on-scalar regression with an ultra-high dimensional predictor vector. We extend the LASSO to functional data in both the $\textit{dense}$…

Statistics Theory · Mathematics 2016-10-25 Rina Foygel Barber , Matthew Reimherr , Thomas Schill

We propose a new estimator, the thresholded scaled Lasso, in high dimensional threshold regressions. First, we establish an upper bound on the $\ell_\infty$ estimation error of the scaled Lasso estimator of Lee et al. (2012). This is a…

Methodology · Statistics 2015-02-11 Laurent Callot , Mehmet Caner , Anders Bredahl Kock , Juan Andres Riquelme

The choice of the tuning parameter in the Lasso is central to its statistical performance in high-dimensional linear regression. In this work, we study tuning regimes under which the Lasso exhibits suboptimal prediction performance, in the…

Statistics Theory · Mathematics 2026-05-19 Guo Liu

Penalization schemes like Lasso or ridge regression are routinely used to regress a response of interest on a high-dimensional set of potential predictors. Despite being decisive, the question of the relative strength of penalization is…

Methodology · Statistics 2018-11-08 Britta Velten , Wolfgang Huber

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been…

Methodology · Statistics 2025-11-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

We compare alternative computing strategies for solving the constrained lasso problem. As its name suggests, the constrained lasso extends the widely-used lasso to handle linear constraints, which allow the user to incorporate prior…

Machine Learning · Statistics 2016-11-08 Brian R. Gaines , Hua Zhou

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

Statistics Theory · Mathematics 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

We propose a general adaptive LASSO method for a quantile regression model. Our method is very interesting when we know nothing about the first two moments of the model error. We first prove that the obtained estimators satisfy the oracle…

Statistics Theory · Mathematics 2016-02-05 Gabriela Ciuperca

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

The network Lasso (nLasso) has been proposed recently as an efficient learning algorithm for massive networked data sets (big data over networks). It extends the well-known least absolute shrinkage and selection operator (Lasso) from…

Machine Learning · Computer Science 2019-07-24 Alexander Jung , Nguyen Tran

Recently, high dimensional vector auto-regressive models (VAR), have attracted a lot of interest, due to novel applications in the health, engineering and social sciences. The presence of temporal dependence poses additional challenges to…

Statistics Theory · Mathematics 2022-09-20 Sagnik Halder , George Michailidis

The Lasso is a popular model selection and estimation procedure for linear models that enjoys nice theoretical properties. In this paper, we study the Lasso estimator for fitting autoregressive time series models. We adopt a double…

Statistics Theory · Mathematics 2008-05-09 Yuval Nardi , Alessandro Rinaldo

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

Statistics Theory · Mathematics 2016-06-23 Darren Homrighausen , Daniel J. McDonald

Sparse linear regression is a vast field and there are many different algorithms available to build models. Two new papers published in Statistical Science study the comparative performance of several sparse regression methodologies,…

Machine Learning · Computer Science 2021-02-10 Owais Sarwar , Benjamin Sauk , Nikolaos V. Sahinidis

In this article we study variable selection problem using LASSO with new improvisations. LASSO uses $\ell_{1}$ penalty, it shrinks most of the coefficients to zero when number of explanatory variables $(p)$ are much larger the number of…

Applications · Statistics 2017-05-19 Ashutosh K. Maurya

We consider the adaptive Lasso estimator with componentwise tuning in the framework of a low-dimensional linear regression model. In our setting, at least one of the components is penalized at the rate of consistent model selection and…

Statistics Theory · Mathematics 2025-11-11 Nicolai Amann , Ulrike Schneider

Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected…

Methodology · Statistics 2021-07-22 Zijian Guo , Domagoj Ćevid , Peter Bühlmann

The LASSO is an attractive regularisation method for linear regression that combines variable selection with an efficient computation procedure. This paper is concerned with enhancing the performance of LASSO for square-free hierarchical…

Methodology · Statistics 2023-05-10 Shaoxiong Hu , Hugo Maruri-Aguliar , Zixiang Ma

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

Statistics Theory · Mathematics 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard
‹ Prev 1 3 4 5 6 7 10 Next ›