English
Related papers

Related papers: Adaptive Methods for Variational Inequalities unde…

200 papers

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the…

Optimization and Control · Mathematics 2012-07-16 Radu Ioan Bot , Christopher Hendrich

We analyze algorithms for solving stochastic variational inequalities (VI) without the bounded variance or bounded domain assumptions, where our main focus is min-max optimization with possibly unbounded constraint sets. We focus on two…

Optimization and Control · Mathematics 2026-02-06 Ahmet Alacaoglu , Jun-Hyun Kim

This paper establishes comprehensive stability results for quasi-variational inequalities (QVIs) under monotone perturbations of the governing operator. We prove strong convergence of both minimal and maximal solutions when sequences of…

Functional Analysis · Mathematics 2025-12-16 M. H. M. Rashid

This article analyses the simple projection method proposed by Izuchukwu et al. [8, Algorithm 3.2] for solving variational inequality problems by incorporating momentum terms. A new step size strategy is also introduced, in which the step…

Optimization and Control · Mathematics 2025-05-12 Gourav Kumar , Santanu Soe , V. Vetrivel

Gradient-variation online learning aims to achieve regret guarantees that scale with variations in the gradients of online functions, which has been shown to be crucial for attaining fast convergence in games and robustness in stochastic…

Machine Learning · Computer Science 2024-11-05 Yan-Feng Xie , Peng Zhao , Zhi-Hua Zhou

Generalized additive models have been popular among statisticians and data analysts in multivariate nonparametric regression with non-Gaussian responses including binary and count data. In this paper, a new likelihood approach for fitting…

Statistics Theory · Mathematics 2008-12-18 Kyusang Yu , Byeong U. Park , Enno Mammen

We introduce an inexact oracle model for variational inequalities (VI) with monotone operator, propose a numerical method which solves such VI's and analyze its convergence rate. As a particular case, we consider VI's with…

Optimization and Control · Mathematics 2022-02-18 Fedor Stonyakin , Alexander Gasnikov , Pavel Dvurechensky , Mohammad Alkousa , Alexander Titov

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

In this paper, we consider a broad class of nonconvex and nonsmooth optimization problems, where one objective component is a nonsmooth weakly convex function composed with a linear operator. By integrating variable smoothing techniques…

Optimization and Control · Mathematics 2025-11-03 Xian-Jun Long , Kang Zeng , Gao-Xi Li , Minh N. Dao , Zai-Yun Peng

This paper proposes a new steepest gradient descent method for solving nonconvex finite minimax problems using non-monotone adaptive step sizes and providing proof of convergence results in cases of the nonconvex, quasiconvex, and…

Optimization and Control · Mathematics 2025-02-05 Nguyen Duc Anh , Tran Ngoc Thang

This paper introduces a family of stochastic extragradient-type algorithms for a class of nonconvex-nonconcave problems characterized by the weak Minty variational inequality (MVI). Unlike existing results on extragradient methods in the…

Optimization and Control · Mathematics 2023-02-20 Thomas Pethick , Olivier Fercoq , Puya Latafat , Panagiotis Patrinos , Volkan Cevher

Shuffling-type gradient methods are favored in practice for their simplicity and rapid empirical performance. Despite extensive development of convergence guarantees under various assumptions in recent years, most require the Lipschitz…

Machine Learning · Computer Science 2025-07-15 Qi He , Peiran Yu , Ziyi Chen , Heng Huang

Stochastic variance reduced methods have shown strong performance in solving finite-sum problems. However, these methods usually require the users to manually tune the step-size, which is time-consuming or even infeasible for some…

Optimization and Control · Mathematics 2023-10-10 Binghui Xie , Chenhan Jin , Kaiwen Zhou , James Cheng , Wei Meng

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

Optimization and Control · Mathematics 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

This paper presents a general convergence theory of penalty based numerical methods for elliptic constrained inequality problems, including variational inequalities, hemivariational inequalities, and variational-hemivariational…

Numerical Analysis · Mathematics 2019-12-18 Weimin Han , Mircea Sofonea

In this paper, we introduce a new method for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. The iterative process is based on two well-known projection method and the hybrid (or…

Optimization and Control · Mathematics 2015-01-30 Yu. V. Malitsky , V. V. Semenov

In this paper, we study a class of generalized inverse mixed variational inequality problems (GIMVIPs). We propose a novel projection-based second-order time-varying dynamical system for solving GIMVIPs. Under the assumptions that the…

Optimization and Control · Mathematics 2026-01-23 Nam Van Tran

We focus on constrained, $L$-smooth, potentially stochastic and nonconvex-nonconcave min-max problems either satisfying $\rho$-cohypomonotonicity or admitting a solution to the $\rho$-weakly Minty Variational Inequality (MVI), where larger…

Optimization and Control · Mathematics 2024-08-14 Ahmet Alacaoglu , Donghwan Kim , Stephen J. Wright

In this paper we first present a novel operator extrapolation (OE) method for solving deterministic variational inequality (VI) problems. Similar to the gradient (operator) projection method, OE updates one single search sequence by solving…

Optimization and Control · Mathematics 2023-06-21 Georgios Kotsalis , Guanghui Lan , Tianjiao Li

We propose an adaptive proximal gradient method for minimizing the sum of two functions, where one is a simple convex function, and the other belongs to one of the three classes: nonconvex smooth, convex nonsmooth, or convex smooth. The key…

Optimization and Control · Mathematics 2026-05-08 Zimeng Wang , Alp Yurtsever
‹ Prev 1 4 5 6 7 8 10 Next ›