English
Related papers

Related papers: Some Methods for Relatively Strongly Monotone Vari…

200 papers

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

This paper proposes a two-point inertial proximal point algorithm to find zero of maximal monotone operators in Hilbert spaces. We obtain weak convergence results and non-asymptotic $O(1/n)$ convergence rate of our proposed algorithm in…

Optimization and Control · Mathematics 2022-07-21 Olaniyi S. Iyiola , Yekini Shehu

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

We propose a novel approach to monotone operator splitting based on the notion of a saddle operator. Under investigation is a highly structured multivariate monotone inclusion problem involving a mix of set-valued, cocoercive, and…

Optimization and Control · Mathematics 2021-03-12 Minh N. Bùi , Patrick L. Combettes

We study variational inequalities which are governed by a strongly monotone and Lipschitz continuous operator $F$ over a closed and convex set $S$. We assume that $S=C\cap A^{-1}(Q)$ is the nonempty solution set of a (multiple-set) split…

Optimization and Control · Mathematics 2019-08-21 Andrzej Cegielski , Aviv Gibali , Simeon Reich , Rafał Zalas

This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone…

Optimization and Control · Mathematics 2025-03-07 Younes Belkouchi , Jean-Christophe Pesquet , Audrey Repetti , Hugues Talbot

The usual approach to developing and analyzing first-order methods for non-smooth (stochastic or deterministic) convex optimization assumes that the objective function is uniformly Lipschitz continuous with parameter $M_f$. However, in many…

Optimization and Control · Mathematics 2018-08-15 Haihao Lu

In this work, we propose and analyse two splitting algorithms for finding a zero of the sum of three monotone operators, one of which is assumed to be Lipschitz continuous. Each iteration of these algorithms require one forward evaluation…

Optimization and Control · Mathematics 2020-01-22 Janosch Rieger , Matthew K. Tam

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

The aim of this paper is to study variation detracting property and con- vergence in variation of the Bernstein-Durrmeyer modifications of the classical Bernstein operators in the space of functions of bounded variation. These problems are…

Classical Analysis and ODEs · Mathematics 2016-05-16 Ozlem Oksuzer , Harun Karsli , Fatma Tasdelen Yesildal

We develop a new proximal-gradient method for minimizing the sum of a differentiable, possibly nonconvex, function plus a convex, possibly non differentiable, function. The key features of the proposed method are the definition of a…

Numerical Analysis · Mathematics 2016-05-13 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato

This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable…

Optimization and Control · Mathematics 2025-09-26 Masahiro Yukawa , Isao Yamada

The part of the analysis of the convergence rate of the mirror descent method that is connected with the adaptive time-varying step size rules due to Alkousa et al. (MOTOR 2024, pp. 3-18) is corrected. Moreover, a Lipschitz-free mirror…

Optimization and Control · Mathematics 2025-06-03 Bowen Yuan , Mohammad S. Alkousa

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

In this paper, a two-step inertial Tseng extragradient method involving self-adaptive and Armijo-like step sizes is introduced for solving variational inequalities with a quasimonotone cost function in the setting of a real Hilbert space.…

Optimization and Control · Mathematics 2026-01-16 Jian-Wen Peng , Jun-Jie Luo , Abubakar Adamu

It is well known that many problems in image recovery, signal processing, and machine learning can be modeled as finding zeros of the sum of maximal monotone and Lipschitz continuous monotone operators. Many papers have studied…

Functional Analysis · Mathematics 2021-01-25 Yekini Shehu

In this paper, we consider the online proximal mirror descent for solving the time-varying composite optimization problems. For various applications, the algorithm naturally involves the errors in the gradient and proximal operator. We…

Optimization and Control · Mathematics 2023-04-11 Woocheol Choi , Myeong-Su Lee , Seok-Bae Yun

We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is…

Optimization and Control · Mathematics 2021-10-12 Fedor S. Stonyakin

We consider a linear ill-posed equation in the Hilbert space setting under white noise. Known convergence results for the discrepancy principle are either restricted to Hilbert-Schmidt operators (and they require a self-similarity condition…

Numerical Analysis · Mathematics 2021-04-14 Tim Jahn

Qualitative and quantitative aspects for variational inequalities governed by strongly pseudomonotone operators on Hilbert space are investigated in this paper. First, we establish a global error bound for the solution set of the given…

Optimization and Control · Mathematics 2020-10-07 Pham Tien Kha , Pham Duy Khanh