English
Related papers

Related papers: Flexible sparse regularization

200 papers

In $\ell^1$-regularization, which is an important tool in signal and image processing, one usually is concerned with signals and images having a sparse representation in some suitable basis, e.g. in a wavelet basis. Many results on…

Optimization and Control · Mathematics 2018-09-28 Jens Flemming , Bernd Hofmann , Ivan Veselic

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements…

Numerical Analysis · Mathematics 2015-08-05 Stephan W. Anzengruber , Bernd Hofmann , Ronny Ramlau

This investigation is motivated by PDE-constrained optimization problems arising in connection with electrocardiograms (ECGs) and electroencephalography (EEG). Standard sparsity regularization does not necessarily produce adequate results…

Numerical Analysis · Mathematics 2023-05-25 Ole Løseth Elvetun , Bjørn Fredrik Nielsen

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

Signal Processing · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has…

Numerical Analysis · Mathematics 2015-06-11 Martin Burger , Jens Flemming , Bernd Hofmann

We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed…

Optimization and Control · Mathematics 2021-11-17 Yuesheng Xu

In the past years, the phenomenon of fractional regularity has been addressed for a large class of linear and/or quasilinear differential operators, mostly, in terms of certain Besov spaces. As it turned out, for equations governed by the…

Analysis of PDEs · Mathematics 2018-09-05 Anderson L. A. de Araújo , Luís H. de Miranda

Very recently, \v{S}pakula and Tikuisis provide a new characterisation of (uniform) Roe algebras via quasi-locality when the underlying metric spaces have straight finite decomposition complexity. In this paper, we improve their method to…

Functional Analysis · Mathematics 2019-03-04 Kang Li , Zhijie Wang , Jiawen Zhang

Sparsity plays a central role in recent developments in signal processing, linear algebra, statistics, optimization, and other fields. In these developments, sparsity is promoted through the addition of an $L^1$ norm (or related quantity)…

Analysis of PDEs · Mathematics 2014-08-04 Russel E. Caflisch , Stanley J. Osher , Hayden Schaeffer , Giang Tran

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

In the context of sparse recovery, it is known that most of existing regularizers such as $\ell_1$ suffer from some bias incurred by some leading entries (in magnitude) of the associated vector. To neutralize this bias, we propose a class…

Optimization and Control · Mathematics 2015-11-24 Zhaosong Lu , Xiaorui Li

Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Yaghoub Rahimi , Sung Ha Kang , Yifei Lou

In this work, we study the affine-constrained $\ell_1$ regularizers, which frequently arise in statistical and machine learning problems across a variety of applications, including microbiome compositional data analysis and sparse subspace…

Optimization and Control · Mathematics 2025-10-09 Xudong Li , Meixia Lin , Kim-Chuan Toh

This work revisits a recent finding by the first author concerning the local convergence of a regularized scalar conservation law. We significantly improve the original statement by establishing a global convergence result within the…

Analysis of PDEs · Mathematics 2024-04-18 Billel Guelmame , Haroune Houamed

In this paper we revisit under-determined linear systems of equations with sparse solutions. As is well known, these systems are among core mathematical problems of a very popular compressed sensing field. The popularity of the field as…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

The constrained $\ell_0$ regularization plays an important role in sparse reconstruction. A widely used approach for solving this problem is the penalty method, of which the least square penalty problem is a special case. However, the…

Optimization and Control · Mathematics 2017-02-01 Na Zhang , Qia Li

A new approximation format for solutions of partial differential equations depending on infinitely many parameters is introduced. By combining low-rank tensor approximation in a selected subset of variables with a sparse polynomial…

Numerical Analysis · Mathematics 2025-06-25 Markus Bachmayr , Huqing Yang

The aim of this paper is to develop the regularity theory for a weak solution to a class of quasilinear nonhomogeneous elliptic equations, whose prototype is the following mixed Dirichlet $p$-Laplace equation of type \begin{align*}…

Analysis of PDEs · Mathematics 2020-03-12 Thanh-Nhan Nguyen , Minh-Phuong Tran