English
Related papers

Related papers: Distribution-aware $\ell_1$ Analysis Minimization

200 papers

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

The explosion of large-scale data in fields such as finance, e-commerce, and social media has outstripped the processing capabilities of single-machine systems, driving the need for distributed statistical inference methods. Traditional…

Machine Learning · Statistics 2024-09-02 Jingguo Lan , Hongmei Lin , Xueqin Wang

Numerical experiments in literature on compressed sensing have indicated that the reweighted $l_1$ minimization performs exceptionally well in recovering sparse signal. In this paper, we develop exact recovery conditions and algorithm for…

Information Theory · Computer Science 2014-06-17 Shenglong Zhou , Naihua Xiu , Yingnan Wang , Lingchen Kong

We consider the problem of detecting the locations of targets in the far field by sending probing signals from an antenna array and recording the reflected echoes. Drawing on key concepts from the area of compressive sensing, we use an…

Information Theory · Computer Science 2013-04-25 Max Hügel , Holger Rauhut , Thomas Strohmer

This paper provides novel results for the recovery of signals from undersampled measurements based on analysis $\ell_1$-minimization, when the analysis operator is given by a frame. We both provide so-called uniform and nonuniform recovery…

Information Theory · Computer Science 2014-11-04 Holger Rauhut , Maryia Kabanava

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

The problem of the distributed recovery of jointly sparse signals has attracted much attention recently. Let us assume that the nodes of a network observe different sparse signals with common support; starting from linear, compressed…

Optimization and Control · Mathematics 2016-11-15 Sophie M. Fosson , Javier Matamoros , Carles Anton-Haro , Enrico Magli

We study the robust mean estimation problem in high dimensions, where $\alpha <0.5$ fraction of the data points can be arbitrarily corrupted. Motivated by compressive sensing, we formulate the robust mean estimation problem as the…

Machine Learning · Statistics 2020-08-24 Jing Liu , Aditya Deshmukh , Venugopal V. Veeravalli

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error between the true and…

Machine Learning · Statistics 2015-12-31 M. Eren Ahsen , M. Vidyasagar

We consider the problem of recovering a partially sparse solution of an underdetermined system of linear equations by minimizing the $\ell_1$-norm of the part of the solution vector which is known to be sparse. Such a problem is closely…

Information Theory · Computer Science 2013-04-11 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

Sparsity is one of the key concepts that allows the recovery of signals that are subsampled at a rate significantly lower than required by the Nyquist-Shannon sampling theorem. Our proposed framework uses arbitrary multiscale transforms,…

Optimization and Control · Mathematics 2017-05-31 Jackie Ma , Maximilian März

As one of the most plausible convex optimization methods for sparse data reconstruction, $\ell_1$-minimization plays a fundamental role in the development of sparse optimization theory. The stability of this method has been addressed in the…

Information Theory · Computer Science 2017-11-09 Yun-Bin Zhao , Houyuan Jiang , Zhi-Quan Luo

In this paper, we propose a support driven reweighted $\ell_1$ minimization algorithm (SDRL1) that solves a sequence of weighted $\ell_1$ problems and relies on the support estimate accuracy. Our SDRL1 algorithm is related to the IRL1…

Information Theory · Computer Science 2012-06-01 Hassan Mansour , Ozgur Yilmaz

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Compressed Sensing refers to extracting a low-dimensional structured signal of interest from its incomplete random linear observations. A line of recent work has studied that, with the extra prior information about the signal, one can…

Information Theory · Computer Science 2017-04-19 Sajad Daei , Farzan Haddadi

We study the recovery conditions of weighted $\ell_1$ minimization for real-valued signal reconstruction from phaseless compressive sensing measurements when partial support information is available. A strong restricted isometry property…

Information Theory · Computer Science 2017-12-14 Zhiyong Zhou , Jun Yu

Sparse learning is an important topic in many areas such as machine learning, statistical estimation, signal processing, etc. Recently, there emerges a growing interest on structured sparse learning. In this paper we focus on the…

Information Theory · Computer Science 2015-03-10 Shubao Zhang , Hui Qian , Zhihua Zhang

Recent results in compressed sensing showed that the optimal subsampling strategy should take into account the sparsity pattern of the signal at hand. This oracle-like knowledge, even though desirable, nevertheless remains elusive in most…

Information Theory · Computer Science 2023-06-28 Simon Ruetz

We first propose a novel criterion that guarantees that an $s$-sparse signal is the local minimizer of the $\ell_1/\ell_2$ objective; our criterion is interpretable and useful in practice. We also give the first uniform recovery condition…

Numerical Analysis · Mathematics 2021-01-29 Yiming Xu , Akil Narayan , Hoang Tran , Clayton G. Webster

In the context of compressed sensing (CS), this paper considers the problem of reconstructing sparse signals with the aid of other given correlated sources as multiple side information. To address this problem, we theoretically study a…

Information Theory · Computer Science 2017-01-19 Huynh Van Luong , Jurgen Seiler , Andre Kaup , Soren Forchhammer , Nikos Deligiannis