English
Related papers

Related papers: A proximal point algorithm revisited and extended

200 papers

Finding a zero of the sum of two monotone operators is one of the most important problems in monotone operator theory, and the forward-backward algorithm is the most prominent approach for solving this type of problem. The aim of this paper…

Functional Analysis · Mathematics 2021-08-12 Ebru ALTIPARMAK , Ibrahim KARAHAN

The Alternating Minimization Algorithm (AMA) has been proposed by Tseng to solve convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the latter is assumed to be…

Optimization and Control · Mathematics 2018-06-04 Sandy Bitterlich , Radu Ioan Bot , Ernö Robert Csetnek , Gert Wanka

We investigate the asymptotic behavior of a stochastic version of the forward-backward splitting algorithm for finding a zero of the sum of a maximally monotone set-valued operator and a cocoercive operator in Hilbert spaces. Our general…

Optimization and Control · Mathematics 2015-07-28 Patrick L. Combettes , Jean-Christophe Pesquet

We propose an abstract stochastic scheme for solving a broad range of monotone operator inclusion problems in Hilbert spaces. This framework allows for the introduction of stochasticity at several levels in monotone operator splitting…

Optimization and Control · Mathematics 2026-02-13 Patrick L. Combettes , Javier I. Madariaga

In this paper, a new optimization framework is defined that includes the optimization framework recently proposed in [1]-[2] as a special case. The convex optimization in [1]-[2] includes centralized optimization and distributed…

Systems and Control · Electrical Eng. & Systems 2019-11-26 S. Sh. Alaviani

Several optimization schemes have been known for convex optimization problems. However, numerical algorithms for solving nonconvex optimization problems are still underdeveloped. A progress to go beyond convexity was made by considering the…

Optimization and Control · Mathematics 2015-06-29 Nguyen Thai An , Nguyen Mau Nam

This paper studies bilinear saddle point problems $\min_{\bf{x}} \max_{\bf{y}} g(\bf{x}) + \bf{x}^{\top} \bf{A} \bf{y} - h(\bf{y})$, where the functions $g, h$ are smooth and strongly-convex. When the gradient and proximal oracle related to…

Machine Learning · Computer Science 2021-03-16 Guangzeng Xie , Yuze Han , Zhihua Zhang

We consider a bilevel problem involving two monotone equilibrium bifunctions and we show that this problem can be solved by a proximal point method with generalized proximal distances. We propose a framework for the convergence analysis of…

Optimization and Control · Mathematics 2014-07-09 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , P. A. Soares , A. Soubeyran

Information divergences allow one to assess how close two distributions are from each other. Among the large panel of available measures, a special attention has been paid to convex $\varphi$-divergences, such as Kullback-Leibler,…

Information Theory · Computer Science 2019-04-09 Mireille El Gheche , Giovanni Chierchia , Jean-Christophe Pesquet

We propose a flexible approach for computing the resolvent of the sum of weakly monotone operators in real Hilbert spaces. This relies on splitting methods where strong convergence is guaranteed. We also prove linear convergence under…

Optimization and Control · Mathematics 2018-09-12 Minh N. Dao , Hung M. Phan

In this paper we propose two proximal gradient algorithms for fractional programming problems in real Hilbert spaces, where the numerator is a proper, convex and lower semicontinuous function and the denominator is a smooth function, either…

Optimization and Control · Mathematics 2016-02-01 Radu Ioan Bot , Ernö Robert Csetnek

This work concerns the zeroth-order global minimization of continuous nonconvex functions with a unique global minimizer and possibly multiple local minimizers. We formulate a theoretical framework for inexact proximal point (IPP) methods…

Optimization and Control · Mathematics 2025-06-03 Minxin Zhang , Fuqun Han , Yat Tin Chow , Stanley Osher , Hayden Schaeffer

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

We apply methods of proof mining to obtain uniform quantitative bounds on the strong convergence of the proximal point algorithm for finding minimizers of convex, lower semicontinuous proper functions in CAT(0) spaces. Thus, for uniformly…

Optimization and Control · Mathematics 2018-02-16 Laurentiu Leustean , Andrei Sipos

In this paper, a multi-parameterized proximal point algorithm combining with a relaxation step is developed for solving convex minimization problem subject to linear constraints. We show its global convergence and sublinear convergence rate…

Numerical Analysis · Mathematics 2019-07-11 Jianchao Bai , Ke Guo , Xiaokai Chang

In this paper, we introduce an inertial proximal method for solving a bilevel problem involving two monotone equilibrium bifunctions in Hilbert spaces. Under suitable conditions and without any restrictive assumption on the trajectories,…

Optimization and Control · Mathematics 2022-10-20 AÏcha Balhag , Zakaria Mazgouri , Michel Théra

We leverage the connections between nonexpansive maps, monotone Lipschitz operators, and proximal mappings to obtain near-optimal (i.e., optimal up to poly-log factors in terms of iteration complexity) and parameter-free methods for solving…

Optimization and Control · Mathematics 2020-04-14 Jelena Diakonikolas

In this paper we provide the resolvent computation of the parallel composition of a maximally monotone operator by a linear operator under mild assumptions. Connections with a modification of the warped resolvent are provided. In the…

Optimization and Control · Mathematics 2022-07-20 Luis Briceño-Arias , Fernando Roldán

Proximal operations are among the most common primitives appearing in both practical and theoretical (or high-level) optimization methods. This basic operation typically consists in solving an intermediary (hopefully simpler) optimization…

Optimization and Control · Mathematics 2021-06-30 Mathieu Barré , Adrien Taylor , Francis Bach

This paper investigates the asymptotic convergence behavior of high-order proximal-point algorithms (HiPPA) toward global minimizers, extending the analysis beyond sublinear convergence rate results. Specifically, we consider the proximal…

Optimization and Control · Mathematics 2025-05-28 Masoud Ahookhosh , Alfredo Iusem , Alireza Kabgani , Felipe Lara