English
Related papers

Related papers: Stochastic Proximal Point Methods for Monotone Inc…

200 papers

This paper focuses on a class of inclusion problems of maximal monotone operators in a multi-agent network, where each agent is characterized by an operator that is not available to any other agents, but the agents can cooperate by…

Optimization and Control · Mathematics 2023-10-25 Kai Gong , Liwei Zhang

In this article, we study the convergence of algorithms for solving monotone inclusions in the presence of adjoint mismatch. The adjoint mismatch arises when the adjoint of a linear operator is replaced by an approximation, due to…

Optimization and Control · Mathematics 2023-11-10 Emilie Chouzenoux , Jean-Christophe Pesquet , Fernando Roldán

The growing prevalence of nonsmooth optimization problems in machine learning has spurred significant interest in generalized smoothness assumptions. Among these, the (L0, L1)-smoothness assumption has emerged as one of the most prominent.…

Optimization and Control · Mathematics 2026-02-24 Zhirayr Tovmasyan , Grigory Malinovsky , Laurent Condat , Peter Richtárik

We propose and analyze the convergence of a novel stochastic algorithm for solving monotone inclusions that are the sum of a maximal monotone operator and a monotone, Lipschitzian operator. The propose algorithm requires only unbiased…

Optimization and Control · Mathematics 2021-02-18 Nguyen Van Dung , Bang Cong Vu

Variational inequalities are a universal optimization paradigm that incorporate classical minimization and saddle point problems. Nowadays more and more tasks require to consider stochastic formulations of optimization problems. In this…

Optimization and Control · Mathematics 2024-09-17 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Vasilii Novitskii , Alexander Gasnikov

The principle underlying this paper is the basic observation that the problem of simultaneously solving a large class of composite monotone inclusions and their duals can be reduced to that of finding a zero of the sum of a maximally…

Optimization and Control · Mathematics 2010-11-29 L. Briceno-Arias , P. L. Combettes

Many problems in nonlinear analysis and optimization, among them variational inequalities and minimization of convex functions, can be reduced to finding zeros (namely, roots) of set-valued operators. Hence numerous algorithms have been…

Optimization and Control · Mathematics 2018-10-23 Daniel Reem , Simeon Reich

The method of monotonization of difference schemes is being considered in the paper. The method was earlier proposed by the author for stationary problems. It is investigated in the paper more profoundly. The idea of the method is to build…

Numerical Analysis · Computer Science 2014-03-13 Y. V. Troshchiev

It is common to encounter large-scale monotone inclusion problems where the objective has a finite sum structure. We develop a general framework for variance-reduced forward-backward splitting algorithms for this problem. This framework…

Machine Learning · Statistics 2021-03-17 Xun Zhang , William B. Haskell , Zhisheng Ye

In this paper, we propose a randomized intertial block-coordinate primaldual fixed point algorithm to solve a wide array of monotone inclusion problems base on the modification of the heavy ball method of Nesterov. These methods rely on a…

Optimization and Control · Mathematics 2016-11-17 Meng Wen , Shigang Yue , Yuchao Tan , Jigen Peng

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

This article studies the solutions of time-dependent differential inclusions which is motivated by their utility in the modeling of certain physical systems. The differential inclusion is described by a time-dependent set-valued mapping…

Optimization and Control · Mathematics 2021-07-05 Kanat Camlibel , Luigi Iannelli , Aneel Tanwani

Many modern solvers and program analyzers rely on non-monotone reasoning (e.g. negation-as-failure, speculative updates, backtracking) for which classical monotone fixed-point methods do not apply. The general problem of finding the fixed…

Programming Languages · Computer Science 2026-05-11 Abdullah H. Rasheed , Vijay K. Garg

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

We introduce the Stochastic Monotone Aggregated Root-Finding (SMART) algorithm, a new randomized operator-splitting scheme for finding roots of finite sums of operators. These algorithms are similar to the growing class of incremental…

Optimization and Control · Mathematics 2016-06-13 Damek Davis

In this work, we propose and study a framework of generalized proximal point algorithms associated with a maximally monotone operator. We indicate sufficient conditions on the regularization and relaxation parameters of generalized proximal…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

We study the convergence of random function iterations for finding an invariant measure of the corresponding Markov operator. We call the problem of finding such an invariant measure the stochastic fixed point problem. This generalizes…

Optimization and Control · Mathematics 2024-04-16 Neal Hermer , D. Russell Luke , Anja Sturm

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

Firstly, we invoke the weak convergence (resp. strong convergence) of translated basic methods involving nonexpansive operators to establish the weak convergence (resp. strong convergence) of the associated method with both perturbation and…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

Stochastic approximation (SA) that involves multiple coupled sequences, known as multiple-sequence SA (MSSA), finds diverse applications in the fields of signal processing and machine learning. However, existing theoretical understandings…

Machine Learning · Computer Science 2024-10-18 Yue Huang , Zhaoxian Wu , Shiqian Ma , Qing Ling