English
Related papers

Related papers: Lasso-type recovery of sparse representations for …

200 papers

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

We examine the rate of convergence of the Lasso estimator of lower dimensional components of the high-dimensional parameter. Under bounds on the $\ell_1$-norm on the worst possible sub-direction these rates are of order $\sqrt {|J| \log p /…

Statistics Theory · Mathematics 2014-03-28 Sara van de Geer

The use of generalized LASSO is a common technique for recovery of structured high-dimensional signals. Each generalized LASSO program has a governing parameter whose optimal value depends on properties of the data. At this optimal value,…

Information Theory · Computer Science 2022-08-25 Aaron Berk , Yaniv Plan , Özgür Yilmaz

We address the issue of estimating the regression vector $\beta$ in the generic $s$-sparse linear model $y = X\beta+z$, with $\beta\in\R^{p}$, $y\in\R^{n}$, $z\sim\mathcal N(0,\sg^2 I)$ and $p> n$ when the variance $\sg^{2}$ is unknown. We…

Statistics Theory · Mathematics 2012-11-06 Stéphane Chrétien , Sébastien Darses

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse…

Machine Learning · Computer Science 2018-08-23 Katsuyuki Hagiwara

The problem of consistently estimating the sparsity pattern of a vector $\betastar \in \real^\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright

Performing statistical inference in high-dimension is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional estimators. Here, we consider linear regression in…

Statistics Theory · Mathematics 2016-06-15 Adel Javanmard , Andrea Montanari

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

We study the problem of high-dimensional variable selection via some two-step procedures. First we show that given some good initial estimator which is $\ell_{\infty}$-consistent but not necessarily variable selection consistent, we can…

Statistics Theory · Mathematics 2008-10-10 Jian Zhang , Xinge Jessie Jeng , Han Liu

This paper studies the statistical properties of the group Lasso estimator for high dimensional sparse quantile regression models where the number of explanatory variables (or the number of groups of explanatory variables) is possibly much…

Methodology · Statistics 2011-03-28 Kengo Kato

Lasso regression is a widely employed approach within the $\ell_1$ regularization framework used to promote sparsity and recover piecewise smooth signals $f:[a,b) \rightarrow \mathbb{R}$ when the given observations are obtained from noisy,…

Numerical Analysis · Mathematics 2025-07-01 Yao Xiao , Anne Gelb , Aditya Viswanathan

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by…

Methodology · Statistics 2017-04-19 Yun Yang

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is done by solving an l_1-regularized linear regression problem, usually called Lasso. In this work we first combine the…

Information Theory · Computer Science 2010-03-02 Pablo Sprechmann , Ignacio Ramirez , Guillermo Sapiro , Yonina C. Eldar

We study the problem of estimating multiple linear regression equations for the purpose of both prediction and variable selection. Following recent work on multi-task learning Argyriou et al. [2008], we assume that the regression vectors…

Machine Learning · Statistics 2012-08-21 Karim Lounici , Massimiliano Pontil , Alexandre B. Tsybakov , Sara van de Geer

We study sparse group Lasso for high-dimensional double sparse linear regression, where the parameter of interest is simultaneously element-wise and group-wise sparse. This problem is an important instance of the simultaneously structured…

Statistics Theory · Mathematics 2022-05-10 T. Tony Cai , Anru R. Zhang , Yuchen Zhou

This article considers recovery of signals that are sparse or approximately sparse in terms of a (possibly) highly overcomplete and coherent tight frame from undersampled data corrupted with additive noise. We show that the properly…

Information Theory · Computer Science 2013-09-10 Junhong Lin , Song Li

This paper addresses the problem of identifying sparse linear time-invariant (LTI) systems from a single sample trajectory generated by the system dynamics. We introduce a Lasso-like estimator for the parameters of the system, taking into…

Systems and Control · Computer Science 2019-04-23 Salar Fattahi , Nikolai Matni , Somayeh Sojoudi

In this article we study post-model selection estimators that apply ordinary least squares (OLS) to the model selected by first-step penalized estimators, typically Lasso. It is well known that Lasso can estimate the nonparametric…

Statistics Theory · Mathematics 2013-03-21 Alexandre Belloni , Victor Chernozhukov

We study the problem of consistently recovering the sparsity pattern of a regression parameter vector from correlated observations governed by deterministic missing data patterns using Lasso. We consider the case in which the observed…

Machine Learning · Computer Science 2022-06-13 Chuyang Ke , Jean Honorio

The problem of recovering the sparsity pattern of a fixed but unknown vector $\beta^* \in \real^p based on a set of $n$ noisy observations arises in a variety of settings, including subset selection in regression, graphical model selection,…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright