English
Related papers

Related papers: Dynamical behavior of a stochastic forward-backwar…

200 papers

We introduce and investigate the convergence properties of an inertial forward-backward-forward splitting algorithm for approaching the set of zeros of the sum of a maximally monotone operator and a single-valued monotone and Lipschitzian…

Optimization and Control · Mathematics 2014-02-24 Radu Ioan Bot , Ernö Robert Csetnek

We provide quantitative information in the form of a rate of metastability in the sense of T. Tao and (under a metric regularity assumption) a rate of convergence for an algorithm approximating zeros of differences of maximally monotone…

Functional Analysis · Mathematics 2022-05-05 Nicholas Pischke

We introduce a generalized forward-backward splitting method with penalty term for solving monotone inclusion problems involving the sum of a finite number of maximally monotone operators and the normal cone to the nonempty set of zeros of…

Optimization and Control · Mathematics 2018-07-31 Nimit Nimana , Narin Petrot

We study in this paper a forward-backward-forward dynamical system for solving a mixed variational inequality problem in a real Hilbert space. For the convergence analysis of our proposed system, we apply the Lyapunov analysis to obtain the…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Chinedu Izuchukwu , Chibueze Christian Okeke

We propose an abstract stochastic scheme for solving a broad range of monotone operator inclusion problems in Hilbert spaces. This framework allows for the introduction of stochasticity at several levels in monotone operator splitting…

Optimization and Control · Mathematics 2026-02-13 Patrick L. Combettes , Javier I. Madariaga

The forward-backward splitting technique is a popular method for solving monotone inclusions that has applications in optimization. In this paper we explore the behaviour of the algorithm when the inclusion problem has no solution. We…

Optimization and Control · Mathematics 2016-08-09 Walaa M. Moursi

A review of the authors's results is given. Several methods are discussed for solving nonlinear equations $F(u)=f$, where $F$ is a monotone operator in a Hilbert space, and noisy data are given in place of the exact data. A discrepancy…

Numerical Analysis · Mathematics 2009-01-29 N. S. Hoang , A. G. Ramm

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is…

Optimization and Control · Mathematics 2021-07-22 Paul-Emile Maingé

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

Optimization and Control · Mathematics 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

A minimal requirement for simulating multi-scale systems is to reproduce the statistical behavior of the slow variables. In particular, a good numerical method should accurately aproximate the probability density function of the…

Dynamical Systems · Mathematics 2018-04-13 J. Frank , G. A. Gottwald

In this work, we propose a new algorithm for finding a zero in the sum of two monotone operators where one is assumed to be single-valued and Lipschitz continuous. This algorithm naturally arises from a non-standard discretization of a…

Optimization and Control · Mathematics 2020-06-17 Ernö Robert Csetnek , Yura Malitsky , Matthew K. Tam

We deal with monotone inclusion problems of the form $0\in Ax+Dx+N_C(x)$ in real Hilbert spaces, where $A$ is a maximally monotone operator, $D$ a cocoercive operator and $C$ the nonempty set of zeros of another cocoercive operator. We…

Functional Analysis · Mathematics 2013-06-04 Radu Ioan Bot , Ernö Robert Csetnek

The purpose of this paper is to establish the almost sure weak ergodic convergence of a sequence of iterates $(x_n)$ given by $x_{n+1} = (I+\lambda_n A(\xi_{n+1},\,.\,))^{-1}(x_n)$ where $(A(s,\,.\,):s\in E)$ is a collection of maximal…

Optimization and Control · Mathematics 2016-07-26 Pascal Bianchi

Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…

Machine Learning · Statistics 2020-05-15 Anas Barakat , Pascal Bianchi

We study asymptotic behaviour of stochastic approximation procedures with three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function.…

Statistics Theory · Mathematics 2016-11-22 Teo Sharia , Lei Zhong

In this work, we approach the problem of finding the zeros of a continuous and monotone operator through a second-order dynamical system with a damping term of the form $1/t^{r}$, where $r\in [0, 1]$. The system features the time derivative…

Optimization and Control · Mathematics 2024-07-23 Radu Ioan Bot , David Alexander Hulett , Dang-Khoa Nguyen

We establish linear convergence of relocated fixed-point iterations as introduced by Atenas et al. (2025) assuming the algorithmic operator satisfies a linear error bound. In particular, this framework applies to the setting where the…

Optimization and Control · Mathematics 2025-12-16 Felipe Atenas , Farhana Ahmed Simi , Matthew K Tam

A dynamic iteration scheme for linear infinite-dimensional port-Hamiltonian systems is proposed. The dynamic iteration is monotone in the sense that the error is decreasing, it does not require any stability condition and is in particular…

Functional Analysis · Mathematics 2023-02-03 Bálint Farkas , Birgit Jacob , Timo Reis , Merlin Schmitz

We study the asymptotic behavior of the trajectory of a nonautonomous evolution equation governed by a quasi-nonexpansive operator in Hilbert spaces. We prove the weak convergence of the trajectory to a fixed point of the operator by…

Optimization and Control · Mathematics 2020-09-08 Ming Zhu , Rong Hu , Ya-Ping Fang

In this work, we propose and analyse two splitting algorithms for finding a zero of the sum of three monotone operators, one of which is assumed to be Lipschitz continuous. Each iteration of these algorithms require one forward evaluation…

Optimization and Control · Mathematics 2020-01-22 Janosch Rieger , Matthew K. Tam