English
Related papers

Related papers: Bregman Monotone Operator Splitting

200 papers

The three-operators splitting algorithm is a popular operator splitting method for finding the zeros of the sum of three maximally monotone operators, with one of which is cocoercive operator. In this paper, we propose a class of inertial…

Optimization and Control · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Yang Yang

Mirror-prox (MP) is a well-known algorithm to solve variational inequality (VI) problems. VI with a monotone operator covers a large group of settings such as convex minimization, min-max or saddle point problems. To get a convergent…

Machine Learning · Computer Science 2020-11-24 Reza Babanezhad , Simon Lacoste-Julien

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

In this paper we consider convergence rate problems for stochastic strongly-convex optimization in the non-Euclidean sense with a constraint set over a time-varying multi-agent network. We propose two efficient non-Euclidean stochastic…

Optimization and Control · Mathematics 2018-08-23 Deming Yuan , Yiguang Hong , Daniel W. C. Ho , Guoping Jiang

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

Optimization and Control · Mathematics 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

It is common in classical mechanics to encounter systems whose Hamiltonian $H$ is the sum of an often exactly integrable Hamiltonian $H_0$ and a small perturbation $\epsilon H_1$ with $\epsilon\ll1$. Such near-integrability can be exploited…

Earth and Planetary Astrophysics · Physics 2020-02-05 Hanno Rein

In this work we focus on the problem of minimizing the sum of convex cost functions in a distributed fashion over a peer-to-peer network. In particular, we are interested in the case in which communications between nodes are prone to…

Optimization and Control · Mathematics 2020-07-24 Nicola Bastianello , Ruggero Carli , Luca Schenato , Marco Todescato

We present a generalization of the proximal operator defined through a convex combination of convex objectives, where the coefficients are updated in a minimax fashion. We prove that this new operator is Bregman firmly nonexpansive with…

Optimization and Control · Mathematics 2025-04-14 Mastane Achab

In this paper, we provide a simple convergence analysis of proximal gradient algorithm with Bregman distance, which provides a tighter bound than existing result. In particular, for the problem of minimizing a class of convex objective…

Optimization and Control · Mathematics 2017-12-19 Yi Zhou , Yingbin Liang , Lixin Shen

We consider the problem of intelligent and efficient task allocation mechanism in large-scale mobile edge computing (MEC), which can reduce delay and energy consumption in a parallel and distributed optimization. In this paper, we study the…

Networking and Internet Architecture · Computer Science 2020-05-22 Xiaoxiong Zhong , Xinghan Wang , Yuanyuan Yang , Yang Qin , Xiaoke Ma , Tingting Yang

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes

We propose and study the weak convergence of a projective splitting algorithm for solving multi-term composite monotone inclusion problems involving the finite sum of $n$ maximal monotone operators, each of which having an inner four-block…

Optimization and Control · Mathematics 2024-05-08 M. Marques Alves

We propose a general approach for distance based clustering, using the gradient of the cost function that measures clustering quality with respect to cluster assignments and cluster center positions. The approach is an iterative two step…

Machine Learning · Computer Science 2022-06-22 Aleksandar Armacki , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

We formulate em algorithm in the framework of Bregman divergence, which is a general problem setting of information geometry. That is, we address the minimization problem of the Bregman divergence between an exponential subfamily and a…

Information Theory · Computer Science 2024-09-10 Masahito Hayashi

We introduce the Stochastic Monotone Aggregated Root-Finding (SMART) algorithm, a new randomized operator-splitting scheme for finding roots of finite sums of operators. These algorithms are similar to the growing class of incremental…

Optimization and Control · Mathematics 2016-06-13 Damek Davis

Proper splittings of operators are commonly used to study the convergence of iterative processes. In order to approximate solutions of operator equations, in this article we deal with proper splittings of closed range bounded linear…

Functional Analysis · Mathematics 2024-03-18 Guillermina Fongi , María Celeste Gonzalez

Several aspects of the interplay between monotone operator theory and convex optimization are presented. The crucial role played by monotone operators in the analysis and the numerical solution of convex minimization problems is emphasized.…

Optimization and Control · Mathematics 2018-06-05 Patrick L. Combettes

Operator-splitting methods are widely used to solve differential equations, especially those that arise from multi-scale or multi-physics models, because a monolithic (single-method) approach may be inefficient or even infeasible. The most…

Numerical Analysis · Mathematics 2025-01-07 Siqi Wei , Victoria Guenter , Raymond J. Spiteri

In this paper, we propose an algorithm combining the forward-backward splitting method and the alternative projection method for solving the system of splitting inclusion problem. We want to find a point in the interception of a finite…

Optimization and Control · Mathematics 2016-04-08 R. Díaz Millán

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

Optimization and Control · Mathematics 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh