English
Related papers

Related papers: $\ell_{1\text{-}2}$ Regularization for Sparse Opti…

200 papers

In this paper, we propose a globally convergent Newton type method to solve $\ell_0$ regularized sparse optimization problem. In fact, a line search strategy is applied to the Newton method to obtain global convergence. The Jacobian matrix…

Optimization and Control · Mathematics 2025-11-26 Yuge Ye , Qingna Li

We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed…

Optimization and Control · Mathematics 2021-11-17 Yuesheng Xu

The sparse optimization problems arise in many areas of science and engineering, such as compressed sensing, image processing, statistical and machine learning. The $\ell_{0}$-minimization problem is one of such optimization problems, which…

Optimization and Control · Mathematics 2019-04-23 Jialiang Xu , Yun-Bin Zhao

We present and analyze a novel sparse polynomial technique for the simultaneous approximation of parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our approach treats the numerical solution as a…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster

Subspace clustering methods based on $\ell_1$, $\ell_2$ or nuclear norm regularization have become very popular due to their simplicity, theoretical guarantees and empirical success. However, the choice of the regularizer can greatly impact…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Chong You , Daniel P. Robinson , Rene Vidal

Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when…

Machine Learning · Computer Science 2026-05-29 Huangyu Xu , Jingqin Yang , Qianqian Xu , Jiaye Teng

Regularization plays an important role in solving ill-posed problems by adding extra information about the desired solution, such as sparsity. Many regularization terms usually involve some vector norm, e.g., $L_1$ and $L_2$ norms. In this…

Numerical Analysis · Mathematics 2021-03-10 Weihong Guo , Yifei Lou , Jing Qin , Ming Yan

Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Yaghoub Rahimi , Sung Ha Kang , Yifei Lou

We propose a unified fractional regularization framework for sparse signal recovery based on the $\ell_1/\ell_p^q$ model. This model generalizes several widely used sparsity-promoting regularizers and provides additional flexibility through…

Information Theory · Computer Science 2026-05-28 Yinhao Zhao , Haoyu He , Chuanqi Ma , Hao Wang

We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take…

Numerical Analysis · Mathematics 2023-11-22 Armenak Petrosyan , Konstantin Pieper , Hoang Tran

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

Numerical Analysis · Mathematics 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements…

Numerical Analysis · Mathematics 2015-08-05 Stephan W. Anzengruber , Bernd Hofmann , Ronny Ramlau

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic…

Statistics Theory · Mathematics 2013-02-28 Anatoli Juditsky , Fatma Kılınç Karzan , Arkadi Nemirovski , Boris Polyak

The Tikhonov regularization of linear ill-posed problems with an $\ell^1$ penalty is considered. We recall results for linear convergence rates and results on exact recovery of the support. Moreover, we derive conditions for exact support…

Functional Analysis · Mathematics 2015-05-18 Dirk A. Lorenz , Stefan Schiffler , Dennis Trede

In this paper, we study (noisy) linear systems, and their $\ell_0$-regularized optimization problems, coupled with general data fidelity terms. Recent approaches for solving this class of problems have proposed to consider non-convex exact…

Optimization and Control · Mathematics 2026-03-23 Jonathan Chirinos-Rodríguez , Cédric Févotte , Emmanuel Soubies

In this work we propose and analyze a novel approach for group sparse recovery. It is based on regularized least squares with an $\ell^0(\ell^2)$ penalty, which penalizes the number of nonzero groups. One distinct feature of the approach is…

Information Theory · Computer Science 2016-12-21 Yuling Jiao , Bangti Jin , Xiliang Lu

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

Numerical Analysis · Mathematics 2020-12-30 Jeffrey Cornelis , Wim Vanroose

Compressed Sensing using $\ell_1$ regularization is among the most powerful and popular sparsification technique in many applications, but why has it not been used to obtain sparse deep learning model such as convolutional neural network…

Machine Learning · Computer Science 2021-10-06 Juncai He , Xiaodong Jia , Jinchao Xu , Lian Zhang , Liang Zhao

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar