English
Related papers

Related papers: A Unifying Framework for Variance Reduction Algori…

200 papers

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

The goal of this paper is to present two algorithms for solving systems of inclusion problems, with all component of the systems being a sum of two maximal monotone operators. The algorithms are variants of the forward-backward splitting…

Optimization and Control · Mathematics 2018-05-28 R. Díaz Millán

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

We consider the primal problem of finding the zeros of the sum of a maximally monotone operator with the composition of another maximally monotone operator with a linear continuous operator and a corresponding dual problem formulated by…

Optimization and Control · Mathematics 2012-06-27 Radu Ioan Bot , Ernö Robert Csetnek , Andre Heinrich

In this paper, we propose an inertial forward backward splitting algorithm to compute a zero of the sum of two monotone operators, with one of the two operators being co-coercive. The algorithm is inspired by the accelerated gradient method…

Computer Vision and Pattern Recognition · Computer Science 2014-09-15 Dirk A. Lorenz , Thomas Pock

In this work, we propose a new splitting algorithm for solving structured monotone inclusion problems composed of a maximally monotone operator, a maximally monotone and Lipschitz continuous operator and a cocoercive operator. Our method…

Optimization and Control · Mathematics 2025-11-07 Liqian Qin , Yuchao Tang , Jigen Peng

The principle underlying this paper is the basic observation that the problem of simultaneously solving a large class of composite monotone inclusions and their duals can be reduced to that of finding a zero of the sum of a maximally…

Optimization and Control · Mathematics 2010-11-29 L. Briceno-Arias , P. L. Combettes

Variational inequalities are a formalism that includes games, minimization, saddle point, and equilibrium problems as special cases. Methods for variational inequalities are therefore universal approaches for many applied tasks, including…

We develop two variance-reduced fast operator splitting methods to approximate solutions of a class of generalized equations, covering fundamental problems such as \rvs{minimization}, minimax problems, and variational inequalities as…

Optimization and Control · Mathematics 2025-08-14 Quoc Tran-Dinh

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

In this paper, under the monotonicity of pairs of operators, we propose some Generalized Proximal Point Algorithms to solve non-monotone inclusions using warped resolvents and transformed resolvents. The weak, strong, and linear convergence…

Optimization and Control · Mathematics 2025-01-24 Ba Khiet Le , Minh N. Dao , Michel Théra

This paper studies the risk-averse mean-variance optimization in infinite-horizon discounted Markov decision processes (MDPs). The involved variance metric concerns reward variability during the whole process, and future deviations are…

Optimization and Control · Mathematics 2022-01-19 Shuai Ma , Xiaoteng Ma , Li Xia

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

The article is devoted to the development of numerical methods for solving saddle point problems and variational inequalities with simplified requirements for the smoothness conditions of functionals. Recently there were proposed some…

Optimization and Control · Mathematics 2023-11-22 Alexander Titov , Fedor Stonyakin , Mohammad Alkousa , Alexander Gasnikov

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

We propose a unified framework for fair regression tasks formulated as risk minimization problems subject to a demographic parity constraint. Unlike many existing approaches that are limited to specific loss functions or rely on challenging…

Methodology · Statistics 2026-01-16 Yongzhen Feng , Weiwei Wang , Raymond K. W. Wong , Xianyang Zhang

Finding a \emph{single} best solution is the most common objective in combinatorial optimization problems. However, such a single solution may not be applicable to real-world problems as objective functions and constraints are only…

Data Structures and Algorithms · Computer Science 2022-01-25 Tesshu Hanaka , Masashi Kiyomi , Yasuaki Kobayashi , Yusuke Kobayashi , Kazuhiro Kurita , Yota Otachi

This paper introduces a systematic methodological framework to design and analyze distributed algorithms for optimization and games over networks. Starting from a centralized method, we identify an aggregation function involving all the…

Optimization and Control · Mathematics 2025-05-26 Guido Carnevale , Nicola Mimmo , Giuseppe Notarstefano