English
Related papers

Related papers: Linear Convergence of Generalized Proximal Point A…

200 papers

Finding multiple solutions of non-convex optimization problems is a ubiquitous yet challenging task. Most past algorithms either apply single-solution optimization methods from multiple random initial guesses or search in the vicinity of…

Machine Learning · Computer Science 2023-03-03 Lingxiao Li , Noam Aigerman , Vladimir G. Kim , Jiajin Li , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

This work studies a class of non-smooth decentralized multi-agent optimization problems where the agents aim at minimizing a sum of local strongly-convex smooth components plus a common non-smooth term. We propose a general primal-dual…

Optimization and Control · Mathematics 2020-07-13 Sulaiman A. Alghunaim , Ernest K. Ryu , Kun Yuan , Ali H. Sayed

The proximal point algorithm (PPA) has been well studied in the literature. In particular, its linear convergence rate has been studied by Rockafellar in 1976 under certain condition. We consider a generalized PPA in the generic setting of…

Optimization and Control · Mathematics 2016-05-19 Min Tao , Xiaoming Yuan

We propose a flexible approach for computing the resolvent of the sum of weakly monotone operators in real Hilbert spaces. This relies on splitting methods where strong convergence is guaranteed. We also prove linear convergence under…

Optimization and Control · Mathematics 2018-09-12 Minh N. Dao , Hung M. Phan

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is…

Optimization and Control · Mathematics 2021-07-22 Paul-Emile Maingé

We propose and analyze the convergence of a novel stochastic algorithm for solving monotone inclusions that are the sum of a maximal monotone operator and a monotone, Lipschitzian operator. The propose algorithm requires only unbiased…

Optimization and Control · Mathematics 2021-02-18 Nguyen Van Dung , Bang Cong Vu

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

In this paper we study the convergence of an iterative algorithm for finding zeros with constraints for not necessarily monotone set-valued operators in a reflexive Banach space. This algorithm, which we call the proximal-projection method…

Exactly Solvable and Integrable Systems · Physics 2007-11-16 Dan Butnariu , Gabor Kassay

Proximal point algorithm has found many applications, and it has been playing fundamental roles in the understanding, design, and analysis of many first-order methods. In this paper, we derive the tight convergence rate in subgradient norm…

Optimization and Control · Mathematics 2023-01-10 Guoyong Gu , Junfeng Yang

In this work, we study resolvent splitting algorithms for solving composite monotone inclusion problems. The objective of these general problems is finding a zero in the sum of maximally monotone operators composed with linear operators.…

Optimization and Control · Mathematics 2022-02-22 Francisco J. Aragón-Artacho , Radu I. Boţ , David Torregrosa-Belén

We study the task of learning Generalized Linear models (GLMs) in the agnostic model under the Gaussian distribution. We give the first polynomial-time algorithm that achieves a constant-factor approximation for \textit{any} monotone…

Machine Learning · Computer Science 2025-08-05 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

In this article, we use the monotonic optimization approach to propose an outcome-space outer approximation by copolyblocks for solving strictly quasiconvex multiobjective programming problems and especially in the case that the objective…

Optimization and Control · Mathematics 2020-03-26 Tran Ngoc Thang , Vijender Kumar Solanki , Tuan Anh Dao , Nguyen Thi Ngoc Anh , Hai V. Pham

We analyze the convergence rate of the monotone accelerated proximal gradient method, which can be used to solve structured convex composite optimization problems. A linear convergence rate is established when the smooth part of the…

Optimization and Control · Mathematics 2026-03-16 Zepeng Wang , Juan Peypouquet

We consider resolvent splitting algorithms for finding a zero of the sum of finitely many maximally monotone operators. The standard approach to solving this type of problem involves reformulating as a two-operator problem in the…

Optimization and Control · Mathematics 2024-12-18 Farhana A. Simi , Matthew K. Tam

We propose stochastic splitting algorithms for solving large-scale composite inclusion problems involving monotone and linear operators. They activate at each iteration blocks of randomly selected resolvents of monotone operators and,…

Optimization and Control · Mathematics 2025-08-07 Patrick L. Combettes , Javier I. Madariaga

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

In this paper we give a unitary approach for the simultaneous study of the convergence of discrete and integral operators described by means of a family of linear continuous functionals acting on functions defined on locally compact…

Functional Analysis · Mathematics 2017-11-28 Gianluca Vinti , Luca Zampogni

We propose a method for solving constrained fixed point problems involving compositions of Lipschitz pseudo contractive and firmly nonexpansive operators in Hilbert spaces. Each iteration of the method uses separate evaluations of these…

Optimization and Control · Mathematics 2011-01-10 Luis M. Briceño-Arias