English
Related papers

Related papers: Iterative Reweighted Minimization Methods for $l_p…

200 papers

In this paper we present a novel numerical method for computing local minimizers of twice smooth differentiable non-linear programming (NLP) problems. So far all algorithms for NLP are based on either of the following three principles:…

Numerical Analysis · Mathematics 2018-03-06 Martin Neuenhofen

The recovery of sparse data is at the core of many applications in machine learning and signal processing. While such problems can be tackled using $\ell_1$-regularization as in the LASSO estimator and in the Basis Pursuit approach,…

Optimization and Control · Mathematics 2021-11-15 Christian Kümmerle , Claudio Mayrink Verdun , Dominik Stöger

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

Robustness and stability of image-reconstruction algorithms have recently come under scrutiny. Their importance to medical imaging cannot be overstated. We review the known results for the topical variational regularization strategies…

Optimization and Control · Mathematics 2023-01-24 Pol del Aguila Pla , Sebastian Neumayer , Michael Unser

We consider the problem of minimizing a differentiable function with locally Lipschitz continuous gradient over the real determinantal variety, and present a first-order algorithm designed to find stationary points of that problem. This…

Optimization and Control · Mathematics 2024-09-04 Guillaume Olikier , P. -A. Absil

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

Numerical Analysis · Mathematics 2020-12-30 Jeffrey Cornelis , Wim Vanroose

The unconstrained minimization of a sufficiently smooth objective function $f(x)$ is considered, for which derivatives up to order $p$, $p\geq 2$, are assumed to be available. An adaptive regularization algorithm is proposed that uses…

Optimization and Control · Mathematics 2021-05-31 Coralia Cartis , Nicholas I. M. Gould , Philippe L. Toint

We study minimisation problems in $L^\infty$ for general quasiconvex first order functionals, where the class of admissible mappings is constrained by the sublevel sets of another supremal functional and by the zero set of a nonlinear…

Analysis of PDEs · Mathematics 2022-02-25 Ed Clark , Nikos Katzourakis

The $\ell_p$ regularization problem with $0< p< 1$ has been widely studied for finding sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. The proximal gradient…

Optimization and Control · Mathematics 2017-08-24 Yaohua Hu , Chong Li , Kaiwen Meng , Xiaoqi Yang

For an ill-posed inverse problem, particularly with incomplete and limited measurement data, regularization is an essential tool for stabilizing the inverse problem. Among various forms of regularization, the lp penalty term provides a…

Numerical Analysis · Mathematics 2021-12-23 Jihun Han , Yoonsang Lee

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

In this article we develop and analyze novel iterative regularization techniques for the solution of systems of nonlinear ill--posed operator equations. The basic idea consists in considering separately each equation of this system and…

Numerical Analysis · Mathematics 2020-11-20 M. Haltmeier , A. Leitao , O. Scherzer

We study the restricted inverse optimal value problem on linear programming under weighted $l_1$ norm (RIOVLP $_1$). Given a linear programming problem $LP_c: \min \{cx|Ax=b,x\geq 0\}$ with a feasible solution $x^0$ and a value $K$, we aim…

Optimization and Control · Mathematics 2023-08-22 Junhua Jia , Xiucui Guan , Xinqiang Qian , Panos M. Pardalos

We propose a novel differentiable reformulation of the linearly-constrained $\ell_1$ minimization problem, also known as the basis pursuit problem. The reformulation is inspired by the Laplacian paradigm of network theory and leads to a new…

Data Structures and Algorithms · Computer Science 2023-05-16 Vincenzo Bonifaci

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

Numerical Analysis · Mathematics 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption,…

Machine Learning · Computer Science 2020-06-26 Bhaskar Mukhoty , Govind Gopakumar , Prateek Jain , Purushottam Kar

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

The aim of this paper is to investigate the use of an entropic projection method for the iterative regularization of linear ill-posed problems. We derive a closed form solution for the iterates and analyze their convergence behaviour both…

Optimization and Control · Mathematics 2020-01-29 Martin Burger , Elena Resmerita , Martin Benning

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

Optimization and Control · Mathematics 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

Methodology · Statistics 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd