English
Related papers

Related papers: Stochastic Halpern Iteration with Variance Reducti…

200 papers

This paper considers the nonconvex nonsmooth problem in which the objective function is Lipschitz continuous. We focus on the stochastic setting where the algorithm can access stochastic function value evaluations with heavy-tailed noise,…

Machine Learning · Computer Science 2026-05-26 Zhuanghua Liu , Luo Luo

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

In this paper, we propose a reflected forward-backward splitting algorithic framework for finding a zero of the sum of finitely many monotone op-erators, including maximally monotone operators, cocoercive operators, and monotone and…

Optimization and Control · Mathematics 2026-05-19 Haowen Zheng , Yongyu Fu , Qiao-Li Dong , Shuangbao Li

We consider monotone inclusion problems where the operators may be expectation-valued, a class of problems that subsumes convex stochastic optimization problems as well as subclasses of stochastic variational inequality and equilibrium…

Optimization and Control · Mathematics 2021-10-19 Shisheng Cui , Uday V. Shanbhag

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

We introduce a penalty term-based splitting algorithm with inertial effects designed for solving monotone inclusion problems involving the sum of maximally monotone operators and the convex normal cone to the (nonempty) set of zeros of a…

Optimization and Control · Mathematics 2015-12-15 Radu Ioan Bot , Ernö Robert Csetnek

In this paper, we study the strong convergence of two Mann-type inertial extragradient algorithms, which are devised with a new step size, for solving a variational inequality problem with a monotone and Lipschitz continuous operator in…

Optimization and Control · Mathematics 2021-07-27 Bing Tan , Jingjing Fan , Songxiao Li

We propose a stochastic optimization method for the minimization of the sum of three convex functions, one of which has Lipschitz continuous gradient as well as restricted strong convexity. Our approach is most suitable in the setting where…

Optimization and Control · Mathematics 2017-02-01 Alp Yurtsever , Bang Cong Vu , Volkan Cevher

We consider the monotone inclusion problems in real Hilbert spaces. Proximal splitting algorithms are very popular technique to solve it and generally achieve weak convergence under mild assumptions. Researchers assume the strong conditions…

Optimization and Control · Mathematics 2022-05-05 Avinash Dixit , D. R. Sahu , Pankaj Gautam , T. Som

A general primal-dual splitting algorithm for solving systems of structured coupled monotone inclusions in Hilbert spaces is introduced and its asymptotic behavior is analyzed. Each inclusion in the primal system features compositions with…

Optimization and Control · Mathematics 2013-02-14 Patrick L. Combettes

We propose a third order dynamical system for solving a nonlinear equation in Hilbert spaces where the operator is cocoercive with respect to the solutions set. Under mild conditions on the parameters, we establish the existence and…

Optimization and Control · Mathematics 2024-06-04 Pham Viet Hai , Phan Tu Vuong

We revisit a classical assumption for analyzing stochastic gradient algorithms where the squared norm of the stochastic subgradient (or the variance for smooth problems) is allowed to grow as fast as the squared norm of the optimization…

Optimization and Control · Mathematics 2025-04-15 Ahmet Alacaoglu , Yura Malitsky , Stephen J. Wright

Continuous-time stochastic processes underlie many natural and engineered systems. In healthcare, autonomous driving, and industrial control, direct interaction with the environment is often unsafe or impractical, motivating offline…

Machine Learning · Statistics 2025-11-14 Nicolas Hoischen , Petar Bevanda , Max Beier , Stefan Sosnowski , Boris Houska , Sandra Hirche

This paper studies the long-time behavior of stochastic differential inclusions driven by maximal monotone operators, motivated by continuous-time models of first-order optimization methods under noisy or approximate operator information.…

Optimization and Control · Mathematics 2026-02-27 Juan Guillermo Garrido , Pedro Pérez-Aros , Mathias Staudigl

Consider the problem of minimizing an expected logarithmic loss over either the probability simplex or the set of quantum density matrices. This problem includes tasks such as solving the Poisson inverse problem, computing the…

Optimization and Control · Mathematics 2024-03-12 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

Qualitative and quantitative aspects for variational inequalities governed by strongly pseudomonotone operators on Hilbert space are investigated in this paper. First, we establish a global error bound for the solution set of the given…

Optimization and Control · Mathematics 2020-10-07 Pham Tien Kha , Pham Duy Khanh

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

In this article we present a modified S-iteration process that we combine with inertial extrapolation to find a common solution to the split monotone inclusion problem and the fixed point problem in real Hilbert space.Our goal is to…

Numerical Analysis · Mathematics 2021-10-11 Shamshad Husain , Uqba Rafat

The paper investigates two inertial extragradient algorithms for seeking a common solution to a variational inequality problem involving a monotone and Lipschitz continuous mapping and a fixed point problem with a demicontractive mapping in…

Optimization and Control · Mathematics 2023-08-08 Bing Tan , Liya Liu , Xiaolong Qin

We propose and study a novel stochastic inertial primal-dual approach to solve composite optimization problems. These latter problems arise naturally when learning with penalized regularization schemes. Our analysis provide convergence…

Optimization and Control · Mathematics 2015-07-06 Lorenzo Rosasco , Silvia Villa , Bang Cong Vu
‹ Prev 1 3 4 5 6 7 10 Next ›