English
Related papers

Related papers: Block-Sparse Recovery via Convex Optimization

200 papers

We present a natural generalization of the recent low rank + sparse matrix decomposition and consider the decomposition of matrices into components of multiple scales. Such decomposition is well motivated in practice as data matrices often…

Systems and Control · Computer Science 2016-08-04 Frank Ong , Michael Lustig

In many applications we seek to recover signals from linear measurements far fewer than the ambient dimension, given the signals have exploitable structures such as sparse vectors or low rank matrices. In this paper we work in a general…

Information Theory · Computer Science 2023-11-14 Xuemei Chen

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

This paper presents a novel Block Iterative Bayesian Algorithm (Block-IBA) for reconstructing block-sparse signals with unknown block structures. Unlike the existing algorithms for block sparse signal recovery which assume the cluster…

Machine Learning · Statistics 2014-12-09 Mehdi Korki , Jingxin Zhang , Cishen Zhang , Hadi Zayyani

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

Sparse coding is a class of unsupervised methods for learning a sparse representation of the input data in the form of a linear combination of a dictionary and a sparse code. This learning framework has led to state-of-the-art results in…

Machine Learning · Computer Science 2021-09-01 Ye Xue , Vincent Lau , Songfu Cai

We consider the problem of recovering a signal from nonlinear transformations, under convex constraints modeling a priori information. Standard feasibility and optimization methods are ill-suited to tackle this problem due to the…

Optimization and Control · Mathematics 2020-06-16 Patrick L. Combettes , Zev. C. Woodstock

A sparse recovery approach for direction finding in partly calibrated arrays composed of subarrays with unknown displacements is introduced. The proposed method is based on mixed nuclear norm and 1 norm minimization and exploits…

Information Theory · Computer Science 2018-02-14 Christian Steffens , Marius Pesavento

We propose two nonconvex regularization methods, LogLOP-l2/l1 and AdaLOP-l2/l1, for recovering block-sparse signals with unknown block partitions. These methods address the underestimation bias of existing convex approaches by extending…

Machine Learning · Computer Science 2026-03-03 Takanobu Furuhashi , Hiroki Kuroda , Masahiro Yukawa , Qibin Zhao , Hidekata Hontani , Tatsuya Yokota

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

We propose a general alternating minimization algorithm for nonconvex optimization problems with separable structure and nonconvex coupling between blocks of variables. To fix our ideas, we apply the methodology to the problem of blind…

Optimization and Control · Mathematics 2018-02-07 Robert Hesse , D. Russell Luke , Shoham Sabach , Matthew K. Tam

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

This work discusses the problem of sparse signal recovery when there is correlation among the values of non-zero entries. We examine intra-vector correlation in the context of the block sparse model and inter-vector correlation in the…

Information Theory · Computer Science 2012-05-22 Bhaskar D. Rao , Zhilin Zhang , Yuzhe Jin

Lower dimensional signal representation schemes frequently assume that the signal of interest lies in a single vector space. In the context of the recently developed theory of compressive sensing (CS), it is often assumed that the signal of…

Information Theory · Computer Science 2014-03-18 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

We consider the problem of recovering fusion frame sparse signals from incomplete measurements. These signals are composed of a small number of nonzero blocks taken from a family of subspaces. First, we show that, by using a-priori…

Information Theory · Computer Science 2014-07-30 Ulaş Ayaz , Sjoerd Dirksen , Holger Rauhut

In this paper, we study the missing sample recovery problem using methods based on sparse approximation. In this regard, we investigate the algorithms used for solving the inverse problem associated with the restoration of missed samples of…

Machine Learning · Statistics 2017-06-29 Amirhossein Javaheri , Hadi Zayyani , Farokh Marvasti

The task of finding a sparse signal decomposition in an overcomplete dictionary is made more complicated when the signal undergoes an unknown modulation (or convolution in the complementary Fourier domain). Such simultaneous sparse recovery…

Information Theory · Computer Science 2019-10-02 Youye Xie , Michael B. Wakin , Gongguo Tang

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock

This paper studies computationally efficient methods and their minimax optimality for high-dimensional clustering and signal recovery under block signal structures. We propose two sets of methods, cross-block feature aggregation PCA…

Methodology · Statistics 2025-04-14 Wu Su , Yumou Qiu