English
Related papers

Related papers: A splitting primal-dual proximity algorithm for so…

200 papers

Nonconvex optimization problems are widespread in modern machine learning and data science. We introduce an extrapolation strategy into a class of preconditioned second-order convex splitting algorithms for nonconvex optimization problems.…

Optimization and Control · Mathematics 2025-12-19 Xinhua Shen , Hongpeng Sun

We propose a new fast algorithm for solving one of the standard formulations of image restoration and reconstruction which consists of an unconstrained optimization problem where the objective includes an $\ell_2$ data-fidelity term and a…

Optimization and Control · Mathematics 2015-05-14 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

In this paper, we consider a nonsmooth convex finite-sum problem with a conic constraint. To overcome the challenge of projecting onto the constraint set and computing the full (sub)gradient, we introduce a primal-dual incremental gradient…

Optimization and Control · Mathematics 2021-05-10 Afrooz Jalilzadeh

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an…

Optimization and Control · Mathematics 2021-06-30 Xin He , Rong Hu , Ya-Ping Fang

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

We introduce and investigate the convergence properties of an inertial forward-backward-forward splitting algorithm for approaching the set of zeros of the sum of a maximally monotone operator and a single-valued monotone and Lipschitzian…

Optimization and Control · Mathematics 2014-02-24 Radu Ioan Bot , Ernö Robert Csetnek

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

We tackle highly nonconvex, nonsmooth composite optimization problems whose objectives comprise a Moreau-Yosida regularized term. Classical nonconvex proximal splitting algorithms, such as nonconvex ADMM, suffer from lack of convergence for…

Optimization and Control · Mathematics 2018-02-28 Emanuel Laude , Tao Wu , Daniel Cremers

In this paper, we consider a class of structured nonsmooth fractional minimization, where the first part of the objective is the ratio of a nonnegative nonsmooth nonconvex function to a nonnegative nonsmooth convex function, while the…

Optimization and Control · Mathematics 2025-12-25 Junpeng Zhou , Na Zhang , Qia Li

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

We propose a new first-order optimisation algorithm to solve high-dimensional non-smooth composite minimisation problems. Typical examples of such problems have an objective that decomposes into a non-smooth empirical risk part and a…

Optimization and Control · Mathematics 2015-07-07 Niao He , Zaid Harchaoui

Primal-dual splitting involving proximity operators in order to be able to find some approximation to the minimizer for a general form of Tikhonov type functional is in the focus of this work. This approximation is produced by a pair of…

Numerical Analysis · Mathematics 2019-03-19 Erdem Altuntac

Dual decomposition has been successfully employed in a variety of distributed convex optimization problems solved by a network of computing and communicating nodes. Often, when the cost function is separable but the constraints are coupled,…

Optimization and Control · Mathematics 2017-09-18 Andrea Simonetto , Hadi Jamali-Rad

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Rakibuzzaman Shah , Nargiz Sultanova , Guoyin Li , Syed Islam

The proximity operator of a convex function is a natural extension of the notion of a projection operator onto a convex set. This tool, which plays a central role in the analysis and the numerical solution of convex optimization problems,…

Optimization and Control · Mathematics 2010-05-19 Patrick L. Combettes , Jean-Christophe Pesquet

We consider empirical risk minimization of linear predictors with convex loss functions. Such problems can be reformulated as convex-concave saddle point problems, and thus are well suitable for primal-dual first-order algorithms. However,…

Optimization and Control · Mathematics 2017-03-09 Jialei Wang , Lin Xiao

This paper concerns a class of composite image reconstruction models for impluse noise removal, which is rather general and covers existing convex and nonconvex models proposed for reconstructing images with impluse noise. For this…

Optimization and Control · Mathematics 2024-03-27 Bujin Li , Shaohua Pan , Tieyong Zeng

This paper addresses the minimization of a finite sum of prox-convex functions under Lipschitz continuity of each component. We propose two variants of the splitting proximal point algorithms proposed in \cite{Bacak,Bertsekas}: one…

Optimization and Control · Mathematics 2026-01-13 Jose de Brito , Felipe Lara , Tran Van Thang