English
Related papers

Related papers: LASSO risk and phase transition under dependence

200 papers

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

Data Structures and Algorithms · Computer Science 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

We consider the framework of penalized estimation where the penalty term is given by a real-valued polyhedral gauge, which encompasses methods such as LASSO, generalized LASSO, SLOPE, OSCAR, PACS and others. Each of these estimators is…

Statistics Theory · Mathematics 2025-11-11 Piotr Graczyk , Ulrike Schneider , Tomasz Skalski , Patrick Tardivel

In this paper, we study the issue of estimating a structured signal $x_0 \in \mathbb{R}^n$ from non-linear and noisy Gaussian observations. Supposing that $x_0$ is contained in a certain convex subset $K \subset \mathbb{R}^n$, we prove that…

Statistics Theory · Mathematics 2017-02-21 Martin Genzel

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

Statistics Theory · Mathematics 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

The aim of this paper is to study the stability of the $\ell_1$ minimization for the compressive phase retrieval and to extend the instance-optimality in compressed sensing to the real phase retrieval setting. We first show that the…

Functional Analysis · Mathematics 2016-01-12 Bing Gao , Yang Wang , Zhiqiang Xu

We study a high-dimensional regression model. Aim is to construct a confidence set for a given group of regression coefficients, treating all other regression coefficients as nuisance parameters. We apply a one-step procedure with the…

Statistics Theory · Mathematics 2015-09-16 Sara van de Geer , Benjamin Stucky

The problem of least squares regression of a $d$-dimensional unknown parameter is considered. A stochastic gradient descent based algorithm with weighted iterate-averaging that uses a single pass over the data is studied and its convergence…

Information Theory · Computer Science 2016-06-10 Kobi Cohen , Angelia Nedic , R. Srikant

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

In multivariate regression, a $K$-dimensional response vector is regressed upon a common set of $p$ covariates, with a matrix $B^*\in\mathbb{R}^{p\times K}$ of regression coefficients. We study the behavior of the multivariate group Lasso,…

Machine Learning · Statistics 2011-03-08 Guillaume Obozinski , Martin J. Wainwright , Michael I. Jordan

In this paper, we present asymptotic high dimensional analysis of the regularised zero-forcing (RZF) receiver in terms of its mean squared error (MSE) and bit error rate (BER) when used for the recovery of binary phase shift keying (BPSK)…

Information Theory · Computer Science 2023-08-11 Ayed M. Alrashdi

Recovering a sparse signal from an undersampled set of random linear measurements is the main problem of interest in compressed sensing. In this paper, we consider the case where both the signal and the measurements are complex. We study…

Information Theory · Computer Science 2015-03-19 Arian Maleki , Laura Anitori , Zai Yang , Richard Baraniuk

Non-ideal oscillators both at the transmitter and the receiver introduces time varying phase noise which interacts with the transmitted data in a non-linear fashion. Phase noise becomes a detrimental problem and needs to be estimated and…

Information Theory · Computer Science 2012-10-24 Arif Onder Isikman , Hani Mehrpouyan , Alexandre Graell i Amat

We study the task of noiseless linear regression under Gaussian covariates in the presence of additive oblivious contamination. Specifically, we are given i.i.d.\ samples from a distribution $(x, y)$ on $\mathbb{R}^d \times \mathbb{R}$ with…

Data Structures and Algorithms · Computer Science 2025-10-14 Ilias Diakonikolas , Chao Gao , Daniel M. Kane , John Lafferty , Ankit Pensia

In Compressed Sensing and high dimensional estimation, signal recovery often relies on sparsity assumptions and estimation is performed via $\ell_1$-penalized least-squares optimization, a.k.a. LASSO. The $\ell_1$ penalisation is usually…

Computation · Statistics 2018-05-07 Stephane Chretien , Alex Gibberd , Sandipan Roy

Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated…

Information Theory · Computer Science 2023-08-29 Jingbo Liu

Recovery of an $N$-dimensional, $K$-sparse solution $\mathbf{x}$ from an $M$-dimensional vector of measurements $\mathbf{y}$ for multivariate linear regression can be accomplished by minimizing a suitably penalized least-mean-square cost…

Information Theory · Computer Science 2019-10-29 Mohammad Ramezanali , Partha P. Mitra , Anirvan M. Sengupta

The lasso procedure is ubiquitous in the statistical and signal processing literature, and as such, is the target of substantial theoretical and applied research. While much of this research focuses on the desirable properties that lasso…

Statistics Theory · Mathematics 2013-08-06 Darren Homrighausen , Daniel J. McDonald

The goal of phaseless compressed sensing is to recover an unknown sparse or approximately sparse signal from the magnitude of its measurements. However, it does not take advantage of any support information of the original signal.…

Information Theory · Computer Science 2022-05-18 Haiye Huo

Compressed sensing is a signal processing scheme that reconstructs high-dimensional sparse signals from a limited number of observations. In recent years, various problems involving signals with a finite number of discrete values have been…

Statistical Mechanics · Physics 2024-08-20 Mikiya Doi , Masayuki Ohzeki

Given data $y$ and $k$ covariates $x$ one problem in linear regression is to decide which in any of the covariates to include when regressing $y$ on the $x$. If $k$ is small it is possible to evaluate each subset of the $x$. If however $k$…

Statistics Theory · Mathematics 2016-05-17 Patrick Laurie Davies