English
Related papers

Related papers: Iterative Thresholding for Demixing Structured Sup…

200 papers

Motivated by the question of optimal functional approximation via compressed sensing, we propose generalizations of the Iterative Hard Thresholding and the Compressive Sampling Matching Pursuit algorithms able to promote sparse in levels…

Information Theory · Computer Science 2021-11-01 Ben Adcock , Simone Brugiapaglia , Matthew King-Roskamp

The problem of recovering a structured signal from its linear measurements in the presence of speckle noise is studied. This problem appears in many imaging systems such as synthetic aperture radar and optical coherence tomography. The…

Information Theory · Computer Science 2021-08-03 Wenda Zhou , Shirin Jalali , Arian Maleki

We consider a structured estimation problem where an observed matrix is assumed to be generated as an $s$-sparse linear combination of $N$ given $n\times n$ positive-semidefinite matrices. Recovering the unknown $N$-dimensional and…

Information Theory · Computer Science 2020-03-27 Fabian Jaensch , Peter Jung

In this paper, we address the line spectral estimation problem with multiple measurement corrupted vectors. Such scenarios appear in many practical applications such as radar, optics, and seismic imaging in which the signal of interest can…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Hoomaan Maskan , Sajad Daei , Mohammad Hossein Kahaei

Nonlinear hyperspectral unmixing has recently received considerable attention, as linear mixture models do not lead to an acceptable resolution in some problems. In fact, most nonlinear unmixing methods are designed by assuming specific…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Saeid Mehrdad , Seyed AmirHossein Janani

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

Information Theory · Computer Science 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

We consider the problem of clustering a set of high-dimensional data points into sets of low-dimensional linear subspaces. The number of subspaces, their dimensions, and their orientations are unknown. We propose a simple and low-complexity…

Information Theory · Computer Science 2013-03-18 Reinhard Heckel , Helmut Bölcskei

Vector valued data appearing in concrete applications often possess sparse expansions with respect to a preassigned frame for each vector component individually. Additionally, different components may also exhibit common sparsity patterns.…

Numerical Analysis · Mathematics 2007-05-23 Massimo Fornasier , Holger Rauhut

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

The purpose of this paper is to propose a non-iterative method for the inverse conductivity problem of recovering multiple small anomalies from the boundary measurements. When small anomalies are buried in a conducting object, the electric…

Analysis of PDEs · Mathematics 2015-06-11 Ok Kyun Lee , Hyeonbae Kang , Jong Chul Ye , Mikyoung Lim

It is widely believed that complex machine learning models generally encode features through linear representations. This is the foundational hypothesis behind a vast body of work on interpretability. A key challenge toward extracting…

Machine Learning · Computer Science 2026-04-01 Allen Liu

Several learning applications require solving high-dimensional regression problems where the relevant features belong to a small number of (overlapping) groups. For very large datasets and under standard sparsity constraints, hard…

Machine Learning · Statistics 2016-05-30 Prateek Jain , Nikhil Rao , Inderjit Dhillon

We consider the problem of recovering a set of correlated signals (e.g., images from different viewpoints) from a few linear measurements per signal. We assume that each sensor in a network acquires a compressed signal in the form of linear…

Networking and Internet Architecture · Computer Science 2015-03-19 Alhussein Fawzi , Tamara Tosic , Pascal Frossard

We consider the problem of recovering a target matrix that is a superposition of low-rank and sparse components, from a small set of linear measurements. This problem arises in compressed sensing of structured high-dimensional signals such…

Information Theory · Computer Science 2012-02-22 John Wright , Arvind Ganesh , Kerui Min , Yi Ma

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

We study the efficient learnability of high-dimensional Gaussian mixtures in the outlier-robust setting, where a small constant fraction of the data is adversarially corrupted. We resolve the polynomial learnability of this problem when the…

Data Structures and Algorithms · Computer Science 2020-05-14 Ilias Diakonikolas , Samuel B. Hopkins , Daniel Kane , Sushrut Karmalkar

In this paper, we investigate the recovery of a sparse weight vector (parameters vector) from a set of noisy linear combinations. However, only partial information about the matrix representing the linear combinations is available. Assuming…

Machine Learning · Computer Science 2016-11-18 Ashkan Esmaeili , Arash Amini , Farokh Marvasti

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Medical imaging involves high-dimensional data, yet their acquisition is obtained for limited samples. Multivariate predictive models have become popular in the last decades to fit some external variables from imaging data, and standard…

Applications · Statistics 2018-06-18 Jérôme-Alexis Chevalier , Joseph Salmon , Bertrand Thirion