English
Related papers

Related papers: Iteratively Reweighted $\ell_1$ Approaches to Spar…

200 papers

Applications of compressed sensing motivate the possibility of using different operators to encode and decode a signal of interest. Since it is clear that the operators cannot be too different, we can view the discrepancy between the two…

Numerical Analysis · Mathematics 2010-04-02 Matthew A. Herman , Deanna Needell

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

Information Theory · Computer Science 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

The transformed $l_1$ penalty (TL1) functions are a one parameter family of bilinear transformations composed with the absolute value function. When acting on vectors, the TL1 penalty interpolates $l_0$ and $l_1$ similar to $l_p$ norm ($p…

Information Theory · Computer Science 2016-10-19 Shuai Zhang , Jack Xin

We propose a convex formulation of the fused lasso signal approximation problem consisting of non-convex penalty functions. The fused lasso signal model aims to estimate a sparse piecewise constant signal from a noisy observation.…

Optimization and Control · Mathematics 2015-12-08 Ankit Parekh , Ivan W. Selesnick

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

This work proposes a method for sparse polynomial chaos (PC) approximation of high-dimensional stochastic functions based on non-adapted random sampling. We modify the standard l1 -minimization algorithm, originally proposed in the context…

Numerical Analysis · Mathematics 2015-06-16 Ji Peng , Jerrad Hampton , Alireza Doostan

We present a novel algorithm that allows us to gain detailed insight into the effects of sparsity in linear and nonlinear optimization, which is of great importance in many scientific areas such as image and signal processing, medical…

Optimization and Control · Mathematics 2021-09-23 Katharina Bieker , Bennet Gebken , Sebastian Peitz

Sparse regularization techniques are well-established in machine learning, yet their application in neural networks remains challenging due to the non-differentiability of penalties like the $L_1$ norm, which is incompatible with stochastic…

Machine Learning · Computer Science 2025-02-10 Chris Kolb , Tobias Weber , Bernd Bischl , David Rügamer

$\ell_1$ minimization is often used for finding the sparse solutions of an under-determined linear system. In this paper we focus on finding sharp performance bounds on recovering approximately sparse signals using $\ell_1$ minimization,…

Information Theory · Computer Science 2010-05-21 Weiyu Xu , Babak Hassibi

Compressed sensing is a new methodology for constructing sensors which allow sparse signals to be efficiently recovered using only a small number of observations. The recovery problem can often be stated as the one of finding the solution…

Methodology · Statistics 2010-11-04 Stephane Chretien

Compressed Sensing aims to capture attributes of a sparse signal using very few measurements. Cand\`{e}s and Tao showed that sparse reconstruction is possible if the sensing matrix acts as a near isometry on all $\boldsymbol{k}$-sparse…

Information Theory · Computer Science 2009-10-18 Robert Calderbank , Stephen Howard , Sina Jafarpour

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg

We introduce a recursive adaptive group lasso algorithm for real-time penalized least squares prediction that produces a time sequence of optimal sparse predictor coefficient vectors. At each time index the proposed algorithm computes an…

Methodology · Statistics 2015-05-27 Yilun Chen , Alfred O. Hero

In many application areas we are faced with the following question: Can we recover a sparse vector $x_o \in \mathbb{R}^N$ from its undersampled set of noisy observations $y \in \mathbb{R}^n$, $y=A x_o+w$. The last decade has witnessed a…

Information Theory · Computer Science 2016-06-14 Le Zheng , Arian Maleki , Haolei Weng , Xiaodong Wang , Teng Long

We propose novel algorithms that enhance the performance of recovering unknown continuous-valued frequencies from undersampled signals. Our iterative reweighted frequency recovery algorithms employ the support knowledge gained from earlier…

Information Theory · Computer Science 2015-10-28 Myung Cho , Kumar Vijay Mishra , Jian-Feng Cai , Weiyu Xu

We present a novel framework for the reconstruction of 1D composite signals assumed to be a mixture of two additive components, one sparse and the other smooth, given a finite number of linear measurements. We formulate the reconstruction…

Signal Processing · Electrical Eng. & Systems 2021-03-25 Thomas Debarre , Shayan Aziznejad , Michael Unser

This work addresses the recovery and demixing problem of signals that are sparse in some general dictionary. Involved applications include source separation, image inpainting, super-resolution, and restoration of signals corrupted by…

Information Theory · Computer Science 2017-03-24 Fei Wen , Lasith Adhikari , Ling Pei , Roummel F. Marcia , Peilin Liu , Robert C. Qiu

Model-based compressed sensing refers to compressed sensing with extra structure about the underlying sparse signal known a priori. Recent work has demonstrated that both for deterministic and probabilistic models imposed on the signal,…

Information Theory · Computer Science 2015-09-07 Sidhant Misra , Pablo A. Parrilo

We address the detection of material defects, which are inside a layered material structure using compressive sensing based multiple-input and multiple-output (MIMO) wireless radar. Here, the strong clutter due to the reflection of the…

Signal Processing · Electrical Eng. & Systems 2022-04-18 Udaya S. K. P. Miriya Thanthrige , Peter Jung , Aydin Sezgin

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves