English
Related papers

Related papers: On the Null Space Constant for $l_p$ Minimization

200 papers

We consider the problem of recovering the support of a sparse signal using noisy projections. While extensive work has been done on the dense measurement matrix setting, the sparse setting remains less explored. In this work, we establish…

Machine Learning · Statistics 2025-09-03 Youssef Chaabouni , David Gamarnik

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

Solving compressed sensing problems relies on the properties of sparse signals. It is commonly assumed that the sparsity s needs to be less than one half of the spark of the sensing matrix A, and then the unique sparsest solution exists,…

Information Theory · Computer Science 2016-10-24 Chun-Kit Lai , Shidong Li , Daniel Mondo

We consider the stable approximation of sparse solutions to non-linear operator equations by means of Tikhonov regularization with a subquadratic penalty term. Imposing certain assumptions, which for a linear operator are equivalent to the…

Functional Analysis · Mathematics 2009-12-06 Markus Grasmair , Markus Haltmeier , Otmar Scherzer

The compatibility constant plays an important role in evaluating the prediction error of the lasso in high-dimensional settings. However, the computation of the compatibility constant is generally difficult because it is a complicated…

Computation · Statistics 2026-03-30 Kei Hirose

In the theory of compressed sensing (CS), the sparsity ||x||_0 of the unknown signal x\in\R^p is commonly assumed to be a known parameter. However, it is typically unknown in practice. Due to the fact that many aspects of CS depend on…

Information Theory · Computer Science 2013-02-26 Miles E. Lopes

Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed…

Numerical Analysis · Mathematics 2018-10-23 Wei Wang , Shuai Lu , Bernd Hofmann , Jin Cheng

The seminal paper of Daubechies, Defrise, DeMol made clear that $\ell^p$ spaces with $p\in [1,2)$ and $p$-powers of the corresponding norms are appropriate settings for dealing with reconstruction of sparse solutions of ill-posed problems…

Numerical Analysis · Mathematics 2016-12-21 Dirk A. Lorenz , Elena Resmerita

Our aim in this paper is to attain a sharp asymptotic estimate for the greedy constant $C_g[\mathcal{H}^{(p)},L_p]$ of the (normalized) Haar system $\mathcal{H}^{(p)}$ in $L_{p}[0,1]$ for $1<p<\infty$. We will show that the superdemocracy…

Functional Analysis · Mathematics 2018-05-07 Fernando Albiac , José L. Ansorena , Pablo M. Berná

We consider the problem of reconstructing an $N$-dimensional continuous vector $\bx$ from $P$ constraints which are generated by its linear transformation under the assumption that the number of non-zero elements of $\bx$ is typically…

Information Theory · Computer Science 2015-05-13 Y. Kabashima , T. Wadayama , T. Tanaka

We study the $\mathcal{L}_p$ induced gain of discrete-time linear switching systems with graph-constrained switching sequences. We first prove that, for stable systems in a minimal realization, for every $p \geq 1$, the $\mathcal{L}_p$-gain…

Dynamical Systems · Mathematics 2016-09-21 Matthew Philippe , Ray Essick , Geir Dullerud , Raphaël Jungers

The Tikhonov regularization of linear ill-posed problems with an $\ell^1$ penalty is considered. We recall results for linear convergence rates and results on exact recovery of the support. Moreover, we derive conditions for exact support…

Functional Analysis · Mathematics 2015-05-18 Dirk A. Lorenz , Stefan Schiffler , Dennis Trede

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

This paper deals with the computational complexity of conditions which guarantee that the NP-hard problem of finding the sparsest solution to an underdetermined linear system can be solved by efficient algorithms. In the literature, several…

Optimization and Control · Mathematics 2013-11-05 Andreas M. Tillmann , Marc E. Pfetsch

For the linear inverse problem with sparsity constraints, the $l_0$ regularized problem is NP-hard, and existing approaches either utilize greedy algorithms to find almost-optimal solutions or to approximate the $l_0$ regularization with…

Machine Learning · Computer Science 2024-02-14 Qinghua Tao , Xiangming Xi , Jun Xu , Johan A. K. Suykens

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

This paper reports an effort to consolidate numerous coherence-based sparse signal recovery results available in the literature. We present a single theory that applies to general Hilbert spaces with the sparsity of a signal defined as the…

Information Theory · Computer Science 2012-05-22 Graeme Pope , Helmut Bölcskei

This paper studies the convergence rate of a continuous-time dynamical system for L1-minimization, known as the Locally Competitive Algorithm (LCA). Solving L1-minimization} problems efficiently and rapidly is of great interest to the…

Dynamical Systems · Mathematics 2017-04-26 Aurèle Balavoine , Christopher J. Rozell , Justin Romberg

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu