English
Related papers

Related papers: An Extragradient-type Algorithm for Variational In…

200 papers

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

Riemannian convex optimization and minimax optimization have recently drawn considerable attention. Their appeal lies in their capacity to adeptly manage the non-convexity of the objective function as well as constraints inherent in the…

Optimization and Control · Mathematics 2024-06-04 Zihao Hu , Guanghui Wang , Xi Wang , Andre Wibisono , Jacob Abernethy , Molei Tao

We examine the linear convergence rates of variants of the proximal point method for finding zeros of maximal monotone operators. We begin by showing how metric subregularity is sufficient for linear convergence to a zero of a maximal…

Optimization and Control · Mathematics 2009-02-25 D. Leventhal

The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. However, several important questions…

Optimization and Control · Mathematics 2022-02-23 Eduard Gorbunov , Hugo Berard , Gauthier Gidel , Nicolas Loizou

This paper explores some sufficient conditions for the enhanced solvability of strong vector equilibrium problems, which can be established via a variational approach. Enhanced solvability here means existence of solutions, which are strong…

Optimization and Control · Mathematics 2022-05-11 Amos Uderzo

A new exponentially convergent algorithm is proposed for an abstract the first order differential equation with unbounded operator coefficient possessing a variable domain. The algorithm is based on a generalization of the Duhamel integral…

Numerical Analysis · Mathematics 2010-03-15 T. Ju. Bohonova , I. P. Gavrilyuk , V. L. Makarov , V. Vasylyk

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

We study the computation of local approximations of invariant manifolds of parabolic fixed points and parabolic periodic orbits of periodic vector fields. If the dimension of these manifolds is two or greater, in general, it is not possible…

Dynamical Systems · Mathematics 2016-03-09 Inmaculada Baldomá , Ernest Fontich , Pau Martín

As a foundation for optimization, convexity is useful beyond the classical settings of Euclidean and Hilbert space. The broader arena of nonpositively curved metric spaces, which includes manifolds like hyperbolic space, as well as metric…

Optimization and Control · Mathematics 2026-03-11 Ariel Goodwin , Adrian S. Lewis , Genaro López-Acedo , Adriana Nicolae

We incorporate inertial terms in the hybrid proximal-extragradient algorithm and investigate the convergence properties of the resulting iterative scheme designed for finding the zeros of a maximally monotone operator in real Hilbert…

Functional Analysis · Mathematics 2014-07-02 Radu Ioan Bot , Ernö Robert Csetnek

Variational inequalities represent a broad class of problems, including minimization and min-max problems, commonly found in machine learning. Existing second-order and high-order methods for variational inequalities require precise…

This paper presents new variants of the averaged alternating modified reflections (AAMR) method for the best approximation problem. Under a mild constraint qualification, we first show its weak convergence and then establish a convergence…

Optimization and Control · Mathematics 2016-09-06 Shin-ya Matsushita

In this paper, we study the strong convergence of an algorithm to solve the variational inequality problem which extends(Thong et al, Numerical Algorithms. 78, 1045-1060 (2018)). We have reduced and refined some of their algorithm's…

Numerical Analysis · Mathematics 2021-05-11 Mostafa Ghadampour , Donal O'Regan , Ebrahim Soori , Ravi. p. Agarwal

Motivated by the substantial instability of the fundamental and high-overtone quasinormal modes, recent developments regarding the notion of black hole pseudospectrum call for numerical results with unprecedented precision. This work…

General Relativity and Quantum Cosmology · Physics 2023-04-12 Kai Lin , Wei-Liang Qian

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

We introduce a generalized finite difference method for solving a large range of fully nonlinear elliptic partial differential equations in three dimensions. Methods are based on Cartesian grids, augmented by additional points carefully…

Numerical Analysis · Mathematics 2021-03-19 Brittany Froese Hamfeldt , Jacob Lesniewski

We present two approximate versions of the proximal subgradient method for minimizing the sum of two convex functions (not necessarily differentiable). The algorithms involve, at each iteration, inexact evaluations of the proximal operator…

Optimization and Control · Mathematics 2019-07-12 Reinier Díaz Millán , Majela Pentón Machado

In recent years, stochastic variance reduction algorithms have attracted considerable attention for minimizing the average of a large but finite number of loss functions. This paper proposes a novel Riemannian extension of the Euclidean…

Machine Learning · Computer Science 2019-06-03 Hiroyuki Sato , Hiroyuki Kasai , Bamdev Mishra

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

Adaptive gradient methods like AdaGrad are widely used in optimizing neural networks. Yet, existing convergence guarantees for adaptive gradient methods require either convexity or smoothness, and, in the smooth setting, only guarantee…

Machine Learning · Computer Science 2019-10-22 Xiaoxia Wu , Simon S. Du , Rachel Ward