English
Related papers

Related papers: Forward-backward-forward methods with variance red…

200 papers

This work describes a new variant of projective splitting for solving maximal monotone inclusions and complicated convex optimization problems. In the new version, cocoercive operators can be processed with a single forward step per…

Optimization and Control · Mathematics 2020-08-24 Patrick R. Johnstone , Jonathan Eckstein

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

We propose a Forward-Backward Truncated-Newton method (FBTN) for minimizing the sum of two convex functions, one of which smooth. Unlike other proximal Newton methods, our approach does not involve the employment of variable metrics, but is…

Optimization and Control · Mathematics 2019-11-11 Andreas Themelis , Masoud Ahookhosh , Panagiotis Patrinos

In this paper, we introduce a large class of convergent numerical methods, based on (linear) basis function regression technique, to approximate the solution to a forward-backward stochastic differential equation with jumps (FBSDEJ…

Computational Finance · Quantitative Finance 2020-11-03 Tingting Ye , Liangliang Zhang

This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone…

Optimization and Control · Mathematics 2025-03-07 Younes Belkouchi , Jean-Christophe Pesquet , Audrey Repetti , Hugues Talbot

We consider monotone inclusion problems where the operators may be expectation-valued, a class of problems that subsumes convex stochastic optimization problems as well as subclasses of stochastic variational inequality and equilibrium…

Optimization and Control · Mathematics 2021-10-19 Shisheng Cui , Uday V. Shanbhag

This paper provides a unifying theoretical framework for stochastic optimization algorithms by means of a latent stochastic variational problem. Using techniques from stochastic control, the solution to the variational problem is shown to…

Machine Learning · Computer Science 2019-10-29 Philippe Casgrain

We propose an extragradient method with stepsizes bounded away from zero for stochastic variational inequalities requiring only pseudo-monotonicity. We provide convergence and complexity analysis, allowing for an unbounded feasible set,…

Optimization and Control · Mathematics 2017-03-02 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

In this paper, we develop an optimization-based framework for solving coupled forward-backward stochastic differential equations. We introduce an integral-form objective function and prove its equivalence to the error between consecutive…

Optimization and Control · Mathematics 2025-07-22 Yutian Wang , Yuan-Hua Ni , Xun Li

We propose some numerical schemes for forward-backward stochastic differential equations (FBSDEs) based on a new fundamental concept of transposition solutions. These schemes exploit time-splitting methods for the variation of constants…

Numerical Analysis · Mathematics 2018-05-01 Kazufumi Ito , Yufei Zhang , Jun Zou

This paper develops new variance-reduction techniques for the forward-reflected-backward splitting (FRBS) method to solve a class of possibly nonmonotone stochastic composite inclusions. Unlike unbiased estimators such as mini-batching,…

Machine Learning · Computer Science 2026-03-17 Quoc Tran-Dinh , Nghia Nguyen-Trung

In this paper, a two-step inertial Tseng extragradient method involving self-adaptive and Armijo-like step sizes is introduced for solving variational inequalities with a quasimonotone cost function in the setting of a real Hilbert space.…

Optimization and Control · Mathematics 2026-01-16 Jian-Wen Peng , Jun-Jie Luo , Abubakar Adamu

In this paper, we propose an Anderson-accelerated stochastic extragradient algorithm for solving a class of stochastic variational inequalities, by incorporating Anderson acceleration into the stochastic extragradient method under a…

Optimization and Control · Mathematics 2026-05-27 Xin Qu , Wei Bian , Xiaojun Chen

This paper proposes a new second-order symmetric algorithm for solving decoupled forward-backward stochastic differential equations. Inspired by the alternating direction implicit splitting method for partial differential equations, we…

Numerical Analysis · Mathematics 2026-01-16 Wenbo Wang , Guangyan Jia

This paper presents a comprehensive analysis of the well-known extragradient (EG) method for solving both equations and inclusions. First, we unify and generalize EG for [non]linear equations to a wider class of algorithms, encompassing…

Optimization and Control · Mathematics 2024-09-26 Quoc Tran-Dinh , Nghia Nguyen-Trung

Tseng's algorithm finds a zero of the sum of a maximally monotone operator and a monotone continuous operator by evaluating the latter twice per iteration. In this paper, we modify Tseng's algorithm for finding a zero of the sum of three…

Optimization and Control · Mathematics 2018-03-26 Luis M. Briceño-Arias , Damek Davis

We propose an inertial variant of the strongly convergent inexact proximal-point (PP) method of Solodov and Svaiter (2000) for monotone inclusions. We prove strong convergence of our main algorithm under less restrictive assumptions on the…

Optimization and Control · Mathematics 2025-09-24 M. Marques Alves , J. E. Navarro Caballero , M. Geremia , R. T. Marcavillaca

We deal with monotone inclusion problems of the form $0\in Ax+Dx+N_C(x)$ in real Hilbert spaces, where $A$ is a maximally monotone operator, $D$ a cocoercive operator and $C$ the nonempty set of zeros of another cocoercive operator. We…

Functional Analysis · Mathematics 2013-06-04 Radu Ioan Bot , Ernö Robert Csetnek

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat