English
Related papers

Related papers: A Unifying Framework for Variance Reduction Algori…

200 papers

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

Optimization and Control · Mathematics 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

We give in this paper a convergence result concerning parallel asynchronous algorithm with bounded delays to solve a nonlinear fixed point problems. This result is applied to calculate the solution of a strongly monotone operator. Special…

Numerical Analysis · Mathematics 2007-05-23 Abdenasser Benahmed

We develop a novel optimistic gradient-type algorithmic framework, combining both Nesterov's acceleration and variance-reduction techniques, to solve a class of generalized equations involving possibly nonmonotone operators in data-driven…

Optimization and Control · Mathematics 2025-08-26 Quoc Tran-Dinh , Nghia Nguyen-Trung

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

We propose stochastic splitting algorithms for solving large-scale composite inclusion problems involving monotone and linear operators. They activate at each iteration blocks of randomly selected resolvents of monotone operators and,…

Optimization and Control · Mathematics 2025-08-07 Patrick L. Combettes , Javier I. Madariaga

We address the problem of finding the zeros of the sum of a maximally monotone operator and a cocoercive operator. Our approach introduces a modification to the forward-backward method by integrating an inertial/momentum term alongside a…

Optimization and Control · Mathematics 2023-12-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

We study the variable metric forward-backward splitting algorithm for convex minimization problems without the standard assumption of the Lipschitz continuity of the gradient. In this setting, we prove that, by requiring only mild…

Optimization and Control · Mathematics 2017-05-02 Saverio Salzo

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

The convergence of a new general variable metric algorithm based on compositions of averaged operators is established. Applications to monotone operator splitting are presented.

Optimization and Control · Mathematics 2018-07-12 Lilian E. Glaudin

We consider the Frank-Wolfe algorithm for solving variational inequalities over compact, convex sets under a monotone $C^1$ operator and vanishing, nonsummable step sizes. We introduce a continuous-time interpolation of the discrete…

Optimization and Control · Mathematics 2026-04-10 Matthew Hough

In this work, we propose and analyse forward-backward-type algorithms for finding a zero of the sum of finitely many monotone operators, which are not based on reduction to a two operator inclusion in the product space. Each iteration of…

Optimization and Control · Mathematics 2022-07-14 Francisco J. Aragón-Artacho , Yura Malitsky , Matthew K. Tam , David Torregrosa-Belén

In this paper we are concerned with solving monotone inclusion problems expressed by the sum of a set-valued maximally monotone operator with a single-valued maximally monotone one and the normal cone to the nonempty set of zeros of another…

Functional Analysis · Mathematics 2014-07-02 Sebastian Banert , Radu Ioan Bot

In this paper we investigate the convergence behavior of a primal-dual splitting method for solving monotone inclusions involving mixtures of composite, Lipschitzian and parallel sum type operators proposed by Combettes and Pesquet in [7].…

Optimization and Control · Mathematics 2012-11-09 Radu Ioan Bot , Christopher Hendrich

We present a family of distributed forward-backward methods with variable stepsizes to find a solution of structured monotone inclusion problems. The framework is constructed by means of relocated fixed-point iterations, extending the…

Optimization and Control · Mathematics 2026-01-23 Felipe Atenas , Minh N. Dao , Matthew K. Tam

We introduce a relaxed inertial forward-backward-forward (RIFBF) splitting algorithm for approaching the set of zeros of the sum of a maximally monotone operator and a single-valued monotone and Lipschitz continuous operator. This work aims…

Optimization and Control · Mathematics 2020-03-24 Radu Ioan Bot , Michael Sedlmayer , Phan Tu Vuong

The deviation vectors provide additional degrees of freedom and effectively enhance the flexibility of algorithms. In the literature, the iterative schemes with deviations are constructed and their convergence analyses are performed on an…

Optimization and Control · Mathematics 2025-09-05 Yongyu Fu , Haowen Zheng , Qiao-Li Dong , Xiaolong Qin , Jing Zhao

We introduce and study the convergence properties of a projection-type algorithm for solving the variational inequality problem for point-to-set operators. No monotoni\-city assumption is used in our analysis. The operator defining the…

Optimization and Control · Mathematics 2017-11-29 Regina S. Burachik , R. Díaz Millán

We study nested variational inequalities, which are variational inequalities whose feasible set is the solution set of another variational inequality. We present a projected averaging Tikhonov algorithm requiring the weakest conditions in…

Optimization and Control · Mathematics 2021-12-20 Lorenzo Lampariello , Gianluca Priori , Simone Sagratella

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

We propose a two-phase systematical framework for approximation algorithm design and analysis via Lyapunov function. The first phase consists of using Lyapunov function as an input and outputs a continuous-time approximation algorithm with…

Optimization and Control · Mathematics 2022-09-08 Donglei Du