English
Related papers

Related papers: Extragradient methods with complexity guarantees f…

200 papers

We study Frank-Wolfe (FW) methods for constrained bilevel optimization when the lower-level problem is solved only approximately, yielding biased and inexact hypergradients. We analyze inexact variants of vanilla FW as well as away-step and…

Optimization and Control · Mathematics 2026-02-27 Anthony Palmieri , Francesco Rinaldi , Saverio Salzo , Sara Venturini

We present a geometric multilevel optimization approach that smoothly incorporates box constraints. Given a box constrained optimization problem, we consider a hierarchy of models with varying discretization levels. Finer models are…

Optimization and Control · Mathematics 2024-04-23 Sebastian Müller , Stefania Petra , Matthias Zisler

In this paper, a two-step inertial Tseng extragradient method involving self-adaptive and Armijo-like step sizes is introduced for solving variational inequalities with a quasimonotone cost function in the setting of a real Hilbert space.…

Optimization and Control · Mathematics 2026-01-16 Jian-Wen Peng , Jun-Jie Luo , Abubakar Adamu

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

This paper deals with the convex feasibility problem, where the feasible set is given as the intersection of a (possibly infinite) number of closed convex sets. We assume that each set is specified algebraically as a convex inequality,…

Optimization and Control · Mathematics 2019-09-27 Ion Necoara , Angelia Nedich

We analyze convergence of the Levenberg-Marquardt method for solving nonlinear inverse problems in Hilbert spaces. Specifically, we establish local convergence and convergence rates for a class of inverse problems that satisfy H\"{o}lder…

Functional Analysis · Mathematics 2025-01-16 Akari Ishida , Sei Nagayasu , Gen Nakamura

In this paper, we propose a random gradient-free method for optimization in infinite dimensional Hilbert spaces, applicable to functional optimization in diverse settings. Though such problems are often solved through finite-dimensional…

Optimization and Control · Mathematics 2025-12-25 Caio Lins Peixoto , Daniel Csillag , Bernardo F. P. da Costa , Yuri F. Saporito

We develop a highly scalable optimization method called "hierarchical group-thresholding" for solving a multi-task regression model with complex structured sparsity constraints on both input and output spaces. Despite the recent emergence…

Machine Learning · Statistics 2012-08-16 Seunghak Lee , Eric P. Xing

We consider stochastic differential equations in a Hilbert space, perturbed by the gradient of a convex potential. We investigate the problem of convergence of a sequence of such processes. We propose applications of this method to…

Probability · Mathematics 2007-05-23 Lorenzo Zambotti

This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary…

Optimization and Control · Mathematics 2024-03-18 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho

We study the existence theory for parabolic variational inequalities in weighted $L^2$ spaces with respect to excessive measures associated with a transition semigroup. We characterize the value function of optimal stopping problems for…

Analysis of PDEs · Mathematics 2011-11-09 Viorel Barbu , Carlo Marinelli

The article studies the reiterated homogenization of linear elliptic variational inequalities arising in problems with unilateral constrains. We assume that the coefficients of the equations satisfy and abstract hypothesis covering on each…

Mathematical Physics · Physics 2018-11-16 Hermann Douanla , Cyrille Kenne

Linear fixed point equations in Hilbert spaces arise in a variety of settings, including reinforcement learning, and computational methods for solving differential and integral equations. We study methods that use a collection of random…

Machine Learning · Computer Science 2020-12-11 Wenlong Mou , Ashwin Pananjady , Martin J. Wainwright

We consider an N-player hierarchical game in which the i-th player's objective comprises of an expectation-valued term, parametrized by rival decisions, and a hierarchical term. Such a framework allows for capturing a broad range of…

Optimization and Control · Mathematics 2024-01-26 Shisheng Cui , Uday V. Shanbhag , Mathias Staudigl

The performance of optimization methods is often tied to the spectrum of the objective Hessian. Yet, conventional assumptions, such as smoothness, do often not enable us to make finely-grained convergence statements -- particularly not for…

Optimization and Control · Mathematics 2024-02-08 Nikita Doikov , Sebastian U. Stich , Martin Jaggi

The constrained gradient method (CGM) has recently been proposed to solve convex optimization and monotone variational inequality (VI) problems with general functional constraints. While existing literature has established convergence…

Optimization and Control · Mathematics 2025-11-24 Danqing Zhou , Hongmei Chen , Shiqian Ma , Junfeng Yang

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

Optimization and Control · Mathematics 2015-11-10 Dang Van Hieu

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

We consider Proximal Newton methods with an inexact computation of update steps. To this end, we introduce two inexactness criteria which characterize sufficient accuracy of these update step and with the aid of these investigate global…

Optimization and Control · Mathematics 2022-04-27 Bastian Pötzl , Anton Schiela , Patrick Jaap

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati