English
Related papers

Related papers: Randomly Aggregated Least Squares for Support Reco…

200 papers

We address the phase retrieval problem with errors in the sensing vectors. A number of recent methods for phase retrieval are based on least squares (LS) formulations which assume errors in the quadratic measurements. We extend this…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Sidharth Gupta , Ivan Dokmanić

We consider the problem of estimating an unknown signal $x_0$ from noisy linear observations $y = Ax_0 + z\in R^m$. In many practical instances, $x_0$ has a certain structure that can be captured by a structure inducing convex function…

Information Theory · Computer Science 2013-11-07 Samet Oymak , Christos Thrampoulidis , Babak Hassibi

We consider the problem of reconstructing the intrinsic geometry of a manifold from noisy pairwise distance observations. Specifically, let $M$ denote a diameter 1 d-dimensional manifold and $\mu$ a probability measure on $M$ that is…

Machine Learning · Statistics 2025-11-18 Charles Fefferman , Jonathan Marty , Kevin Ren

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

The synchronization problem over the special orthogonal group $SO(d)$ consists of estimating a set of unknown rotations $R_1,R_2,...,R_n$ from noisy measurements of a subset of their pairwise ratios $R_{i}^{-1}R_{j}$. The problem has found…

Information Theory · Computer Science 2013-07-17 Lanhui Wang , Amit Singer

In this work, we study the robust phase retrieval problem where the task is to recover an unknown signal $\theta^* \in \mathbb{R}^d$ in the presence of potentially arbitrarily corrupted magnitude-only linear measurements. We propose an…

Machine Learning · Computer Science 2024-09-10 Adarsh Barik , Anand Krishna , Vincent Y. F. Tan

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2011-11-08 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

We study the problem of jointly sparse support recovery with 1-bit compressive measurements in a sensor network. Sensors are assumed to observe sparse signals having the same but unknown sparse support. Each sensor quantizes its measurement…

Information Theory · Computer Science 2015-06-02 Vipul Gupta , Bhavya Kailkhura , Thakshila Wimalajeewa , Pramod K. Varshney

The affine rank minimization (ARM) problem is well known for both its applications and the fact that it is NP-hard. One of the most successful approaches, yet arguably underrepresented, is iteratively reweighted least squares (IRLS), more…

Optimization and Control · Mathematics 2021-06-29 Sebastian Krämer

Constrained least squares regression is an essential tool for high-dimensional data analysis. Given a partition $\mathcal{G}$ of input variables, this paper considers a particular class of nonconvex constraint functions that encourage the…

Machine Learning · Statistics 2014-10-28 Fabian L. Wauthier , Peter Donnelly

In signal processing and data recovery, reconstructing a signal from quadratic measurements poses a significant challenge, particularly in high-dimensional settings where measurements $m$ is far less than the signal dimension $n$ (i.e., $m…

Information Theory · Computer Science 2025-07-11 Jinming Wen , Yi Hu , Meng Huang

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

We propose and study a row-and-column affine measurement scheme for low-rank matrix recovery. Each measurement is a linear combination of elements in one row or one column of a matrix $X$. This setting arises naturally in applications from…

Machine Learning · Computer Science 2015-05-26 Avishai Wagner , Or Zuk

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

Machine Learning · Computer Science 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

We give a new approach to the dictionary learning (also known as "sparse coding") problem of recovering an unknown $n\times m$ matrix $A$ (for $m \geq n$) from examples of the form \[ y = Ax + e, \] where $x$ is a random vector in $\mathbb…

Data Structures and Algorithms · Computer Science 2014-11-11 Boaz Barak , Jonathan A. Kelner , David Steurer

This paper investigates the phase retrieval problem, which aims to recover a signal from the magnitudes of its linear measurements. We develop statistically and computationally efficient algorithms for the situation when the measurements…

Machine Learning · Statistics 2017-05-19 Huishuai Zhang , Yuejie Chi , Yingbin Liang

We investigate recovery of nonnegative vectors from non-adaptive compressive measurements in the presence of noise of unknown power. In the absence of noise, existing results in the literature identify properties of the measurement that…

Information Theory · Computer Science 2017-03-13 Richard Kueng , Peter Jung

In this paper, we consider a compressed sensing problem of reconstructing a sparse signal from an undersampled set of noisy linear measurements. The regularized least squares or least absolute shrinkage and selection operator (LASSO)…

Information Theory · Computer Science 2014-10-30 Chao-Kai Wen , Jun Zhang , Kai-Kit Wong , Jung-Chieh Chen , Chau Yuen

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

Machine Learning · Statistics 2008-05-21 Dapo Omidiran , Martin J. Wainwright