English
Related papers

Related papers: An Efficient Augmented Lagrangian Method with Semi…

200 papers

The conjugate gradient (CG) method is commonly used for the rapid solution of least squares problems. In image reconstruction, the problem can be ill-posed and also contaminated by noise; due to this, approaches such as regularization…

Optimization and Control · Mathematics 2018-02-14 Marcelo V. W. Zibetti , Chuan Lin , Gabor T. Herman

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

We present a powerful and easy-to-implement algorithm for solving constrained optimization problems that involve $L_1$/total-variation regularization terms, and both equality and inequality constraints. We discuss the relationship of our…

Optimization and Control · Mathematics 2015-05-22 Musa Maharramov , Stewart A. Levin

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

In this paper, we consider the efficient numerical minimization of Tikhonov functionals resulting from total-variation (TV) regularization of linear inverse problems. Since the TV penalty is non-smooth, this is typically done either via…

Numerical Analysis · Mathematics 2026-05-13 Helmut Gfrerer , Simon Hubmer , Stefan Kindermann , Jaakko Kultima , Ronny Ramlau , Tanja Tarvainen

In this thesis, we offer a thorough investigation of different regularisation terms used in variational imaging problems, together with detailed optimisation processes of these problems. We begin by studying smooth problems and partially…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Joseph Bartlett , Jinming Duan

The octagonal shrinkage and clustering algorithm for regression (OSCAR), equipped with the $\ell_1$-norm and a pair-wise $\ell_{\infty}$-norm regularizer, is a useful tool for feature selection and grouping in high-dimensional data…

Optimization and Control · Mathematics 2018-03-29 Ziyan Luo , Defeng Sun , Kim-Chuan Toh , Naihua Xiu

Total variation has proved its effectiveness in solving inverse problems for compressive sensing. Besides, the nonlocal means filter used as regularization preserves texture better for recovered images, but it is quite complex to implement.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-30 Trinh Van Chien , Khanh Quoc Dinh , Viet Anh Nguyen , Byeungwoo Jeon

The generalized alternating direction method of multipliers (ADMM) of Xiao et al. [{\tt Math. Prog. Comput., 2018}] aims at the two-block linearly constrained composite convex programming problem, in which each block is in the form of…

Optimization and Control · Mathematics 2022-04-05 Hongwu Li , Haibin Zhang , Yunhai Xiao

This paper presents an efficient algorithm to solve total variation (TV) regularizations of images contaminated by a both blur and noise. The unconstrained structure of the problem suggests that one can solve a constrained optimization…

Numerical Analysis · Computer Science 2018-02-13 A. Bentbib , M. El Guide , K. Jbilou

We propose two variants of Newton method for solving unconstrained minimization problem. Our method leverages optimization techniques such as penalty and augmented Lagrangian method to generate novel variants of the Newton method namely the…

Optimization and Control · Mathematics 2022-05-24 Md Sarowar Morshed

We propose a second-order total generalized variation (TGV) regularization for the reconstruction of the initial condition in variational data assimilation problems. After showing the equivalence between TGV regularization and the Bayesian…

Optimization and Control · Mathematics 2018-04-13 J. C. De los Reyes , E. Loayza

Feature selection is an important and active research area in statistics and machine learning. The Elastic Net is often used to perform selection when the features present non-negligible collinearity or practitioners wish to incorporate…

Machine Learning · Statistics 2020-06-09 Tobia Boschi , Matthew Reimherr , Francesca Chiaromonte

We present a proximal augmented Lagrangian based solver for general convex quadratic programs (QPs), relying on semismooth Newton iterations with exact line search to solve the inner subproblems. The exact line search reduces in this case…

Optimization and Control · Mathematics 2020-04-02 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

In this paper, we propose a uniform semismooth Newton-based algorithmic framework called SSNCVX for solving a broad class of convex composite optimization problems. By exploiting the augmented Lagrangian duality, we reformulate the original…

Optimization and Control · Mathematics 2025-09-16 Zhanwang Deng , Tao Wei , Jirui Ma , Zaiwen Wen

We consider the efficient minimization of a nonlinear, strictly convex functional with $\ell_1$-penalty term. Such minimization problems appear in a wide range of applications like Tikhonov regularization of (non)linear inverse problems…

Optimization and Control · Mathematics 2016-04-12 Esther Hans , Thorsten Raasch

This paper proposes a novel approach to solving nonlinear programming problems using a sharp augmented Lagrangian method with a smoothing technique. Traditional sharp augmented Lagrangian methods are known for their effectiveness but are…

Optimization and Control · Mathematics 2024-10-07 José Luis Romero , Damián Fernandez , Germán Ariel Torres

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

The Truncated Nonsmooth Newton Multigrid (TNNMG) method is a well-established method for the solution of strictly convex block-separably nondifferentiable minimization problems. It achieves multigrid-like performance even for non-smooth…

Numerical Analysis · Mathematics 2017-10-19 Oliver Sander