English
Related papers

Related papers: Bregman three-operator splitting methods

200 papers

We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them. The function $f$ may…

Optimization and Control · Mathematics 2019-01-28 Fred Moolekamp , Peter Melchior

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint splitting, for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical…

Optimization and Control · Mathematics 2016-10-17 Puya Latafat , Panagiotis Patrinos

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

We propose efficient Langevin Monte Carlo algorithms for sampling distributions with nonsmooth convex composite potentials, which is the sum of a continuously differentiable function and a possibly nonsmooth function. We devise such…

Machine Learning · Statistics 2022-07-12 Tim Tsz-Kit Lau , Han Liu

In this paper we investigate the applicability of a recently introduced primal-dual splitting method in the context of solving portfolio optimization problems which assume the minimization of risk measures associated to different convex…

Optimization and Control · Mathematics 2013-04-30 Radu Ioan Bot , Christopher Hendrich

In this paper, we propose two novel non-stationary first-order primal-dual algorithms to solve nonsmooth composite convex optimization problems. Unlike existing primal-dual schemes where the parameters are often fixed, our methods use…

Optimization and Control · Mathematics 2020-07-13 Quoc Tran-Dinh , Yuzixuan Zhu

Recently the primal-dual method of multipliers (PDMM), a novel distributed optimization method, was proposed for solving a general class of decomposable convex optimizations over graphic models. In this work, we first study the convergence…

Optimization and Control · Mathematics 2017-08-24 Guoqiang Zhang , W. Bastiaan Kleijn , Richard Heusdens

A bi-level optimization framework (BiOPT) was proposed in [3] for convex composite optimization, which is a generalization of bi-level unconstrained minimization framework (BLUM) given in [20]. In this continuation paper, we introduce a…

Optimization and Control · Mathematics 2021-09-28 Masoud Ahookhosh , Yurii Nesterov

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

This paper proposes a method for designing diagonal preconditioners for a preconditioned primal-dual splitting method (P-PDS), an efficient algorithm that solves nonsmooth convex optimization problems. To speed up the convergence of P-PDS,…

Signal Processing · Electrical Eng. & Systems 2023-07-25 Kazuki Naganuma , Shunsuke Ono

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

Optimization and Control · Mathematics 2023-03-15 Lénaïc Chizat

We propose and analyze an adaptive step-size variant of the Davis-Yin three operator splitting. This method can solve optimization problems composed by a sum of a smooth term for which we have access to its gradient and an arbitrary number…

Optimization and Control · Mathematics 2018-08-02 Fabian Pedregosa , Gauthier Gidel

The aim of this paper is to study the weak convergence analysis of sequence of iterates generated by a three-operator splitting method of Davis and Yin incorporated with two-step inertial extrapolation for solving monotone inclusion problem…

Optimization and Control · Mathematics 2024-10-03 Olaniyi S. Iyiola , Lateef O. Jolaoso , Yekini Shehu

Based on the idea of randomized coordinate descent of $\alpha$-averaged operators, a randomized primal-dual optimization algorithm is introduced, where a random subset of coordinates is updated at each iteration. The algorithm builds upon a…

Optimization and Control · Mathematics 2015-10-01 Pascal Bianchi , Walid Hachem , Franck Iutzeler

In this paper, we propose a primal-dual splitting algorithm for a broad class of structured composite monotone inclusions that involve finitely many set-valued operators, compositions of set-valued operators with bounded linear operators,…

Optimization and Control · Mathematics 2026-05-14 Minh N. Dao , Hung M. Phan , Matthew K. Tam , Thang D. Truong

We propose a primal-dual splitting algorithm for solving monotone inclusions involving a mixture of sums, linear compositions, and parallel sums of set-valued and Lipschitzian operators. An important feature of the algorithm is that the…

Optimization and Control · Mathematics 2011-08-09 Patrick L. Combettes , Jean-Christophe Pesquet

In this paper we study the convergence of an iterative algorithm for finding zeros with constraints for not necessarily monotone set-valued operators in a reflexive Banach space. This algorithm, which we call the proximal-projection method…

Exactly Solvable and Integrable Systems · Physics 2007-11-16 Dan Butnariu , Gabor Kassay
‹ Prev 1 4 5 6 7 8 10 Next ›