English
Related papers

Related papers: Sharp thresholds for high-dimensional and noisy re…

200 papers

In this work, we study the problem of learning a nonlinear dynamical system by parameterizing its dynamics using basis functions. We assume that disturbances occur at each time step with an arbitrary probability $p$, which models the…

Optimization and Control · Mathematics 2025-03-24 Haixiang Zhang , Baturalp Yalcin , Javad Lavaei , Eduardo D. Sontag

Meinshausen and Buhlmann [Ann. Statist. 34 (2006) 1436--1462] showed that, for neighborhood selection in Gaussian graphical models, under a neighborhood stability condition, the LASSO is consistent, even when the number of variables is of…

Statistics Theory · Mathematics 2008-08-08 Cun-Hui Zhang , Jian Huang

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

Machine Learning · Computer Science 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex…

Machine Learning · Statistics 2014-12-22 Yang Cao , Yao Xie

Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured…

Information Theory · Computer Science 2012-05-09 Thomas Blumensath

We consider the following basic inference problem: there is an unknown high-dimensional vector $w \in \mathbb{R}^n$, and an algorithm is given access to labeled pairs $(x,y)$ where $x \in \mathbb{R}^n$ is a measurement and $y = w \cdot x +…

Computational Complexity · Computer Science 2019-11-05 Xue Chen , Anindya De , Rocco A. Servedio

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2010-04-06 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error between the true and…

Machine Learning · Statistics 2015-12-31 M. Eren Ahsen , M. Vidyasagar

We consider the problem of estimating a sparse linear regression vector $\beta^*$ under a gaussian noise model, for the purpose of both prediction and model selection. We assume that prior knowledge is available on the sparsity pattern,…

Statistics Theory · Mathematics 2012-08-21 Karim Lounici , Massimiliano Pontil , Alexandre B. Tsybakov , Sara van de Geer

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

Statistics Theory · Mathematics 2018-11-12 David Gamarnik , Ilias Zadik

We analyze the performance of the least absolute shrinkage and selection operator (Lasso) for the linear model when the number of regressors $N$ grows larger keeping the true support size $d$ finite, i.e., the ultra-sparse case. The result…

Disordered Systems and Neural Networks · Physics 2023-02-28 Koki Okajima , Xiangming Meng , Takashi Takahashi , Yoshiyuki Kabashima

In this paper, we consider the sparse phase retrieval problem, recovering an $s$-sparse signal $\bm{x}^{\natural}\in\mathbb{R}^n$ from $m$ phaseless samples $y_i=|\langle\bm{x}^{\natural},\bm{a}_i\rangle|$ for $i=1,\ldots,m$. Existing…

Numerical Analysis · Mathematics 2021-10-15 Jian-Feng Cai , Jingzhi Li , Xiliang Lu , Juntao You

We discuss two new methods of recovery of sparse signals from noisy observation based on $\ell_1$- minimization. They are closely related to the well-known techniques such as Lasso and Dantzig Selector. However, these estimators come with…

Statistics Theory · Mathematics 2014-04-11 Anatoli Iouditski , Arkadii S. Nemirovski

We consider multichannel sparse recovery problem where the objective is to find good recovery of jointly sparse unknown signal vectors from the given multiple measurement vectors which are different linear combinations of the same known…

Information Theory · Computer Science 2015-06-11 Esa Ollila

Many applications concern sparse signals, for example, detecting anomalies from the differences between consecutive images taken by surveillance cameras. This paper focuses on the problem of recovering a K-sparse signal x in N dimensions.…

Machine Learning · Statistics 2013-02-06 Ping Li , Cun-Hui Zhang

In this paper a new result of recovery of sparse vectors from deterministic and noisy measurements by l1 minimization is given. The sparse vector is randomly chosen and follows a generic p-sparse model introduced by Candes and al. The main…

Optimization and Control · Mathematics 2012-12-04 Charles Dossal , Rémi Tesson

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

The population recovery problem is a basic problem in noisy unsupervised learning that has attracted significant research attention in recent years [WY12,DRWY12, MS13, BIMP13, LZ15,DST16]. A number of different variants of this problem have…

Data Structures and Algorithms · Computer Science 2017-03-07 Anindya De , Ryan O'Donnell , Rocco Servedio

For statistical modeling wherein the data regime is unfavorable in terms of dimensionality relative to the sample size, finding hidden sparsity in the ground truth can be critical in formulating an accurate statistical model. The so-called…

Optimization and Control · Mathematics 2025-08-04 Matteo Bergamaschi , Andrea Cristofari , Vyacheslav Kungurtsev , Francesco Rinaldi