English
Related papers

Related papers: Adaptive Proximal Method for Variational Inequalit…

200 papers

In this technical note, we are concerned with the problem of solving variational inequalities with improved convergence rates. Motivated by Nesterov's accelerated gradient method for convex optimization, we propose a Nesterov's accelerated…

Optimization and Control · Mathematics 2022-12-21 Shaolin Tan , Jinhu Lu

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

We develop an advanced mean field method for approximating averages in probabilistic data models that is based on the TAP approach of disorder physics. In contrast to conventional TAP, where the knowledge of the distribution of couplings…

Disordered Systems and Neural Networks · Physics 2009-11-07 Manfred Opper , Ole Winther

In this paper, we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems, and variational inequalities. This framework allows obtaining many…

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

Theoretical estimates of the convergence rate of many well-known gradient-type optimization methods are based on quadratic interpolation, provided that the Lipschitz condition for the gradient is satisfied. In this article we obtain a…

Optimization and Control · Mathematics 2018-12-18 Fedor S. Stonyakin

A type of adaptive finite element method for the eigenvalue problems is proposed based on the multilevel correction scheme. In this method, adaptive finite element method to solve eigenvalue problems involves solving associated boundary…

Numerical Analysis · Mathematics 2012-01-12 Hehu Xie

We address the numerical approximation of Mean Field Games with local couplings. For power-like Hamiltonians, we consider both unconstrained and constrained stationary systems with density constraints in order to model hard congestion…

Optimization and Control · Mathematics 2019-02-08 L. M. Briceño-Arias , D. Kalise , F. J. Silva

In this paper, we study a class of generalized inverse mixed variational inequality problems (GIMVIPs). We propose a novel projection-based second-order time-varying dynamical system for solving GIMVIPs. Under the assumptions that the…

Optimization and Control · Mathematics 2026-01-23 Nam Van Tran

This paper is concerned with the weak solvability of fully nonlinear parabolic variational inequalities with time dependent convex constraints. As possible approaches to such problems, there are for instance the time-discretization method…

Functional Analysis · Mathematics 2017-06-21 Maria Gokieli , Nobuyuki Kenmochi , Marek Niezgódka

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

We propose an adaptive proximal gradient method for minimizing the sum of two functions, where one is a simple convex function, and the other belongs to one of the three classes: nonconvex smooth, convex nonsmooth, or convex smooth. The key…

Optimization and Control · Mathematics 2026-05-08 Zimeng Wang , Alp Yurtsever

Context: Adaptive monitoring is a method used in a variety of domains for responding to changing conditions. It has been applied in different ways, from monitoring systems' customization to re-composition, in different application domains.…

Software Engineering · Computer Science 2018-09-05 Edith Zavala , Xavier Franch , Jordi Marco

This paper introduces a deep learning method for solving an elliptic hemivariational inequality (HVI). In this method, an expectation minimization problem is first formulated based on the variational principle of underlying HVI, which is…

Numerical Analysis · Mathematics 2021-04-13 Jianguo Huang , Chunmei Wang , Haoqin Wang

We introduce the Variational Holder (VH) bound as an alternative to Variational Bayes (VB) for approximate Bayesian inference. Unlike VB which typically involves maximization of a non-convex lower bound with respect to the variational…

Machine Learning · Statistics 2015-06-22 Guillaume Bouchard , Balaji Lakshminarayanan

Variational inequalities offer a versatile and straightforward approach to analyzing a broad range of equilibrium problems in both theoretical and practical fields. In this paper, we consider a composite generally non-monotone variational…

Optimization and Control · Mathematics 2025-02-06 Roman Emelyanov , Andrey Tikhomirov , Aleksandr Beznosikov , Alexander Gasnikov

Modifying von Neumann's alternating projections algorithm, we obtain an alternating method for solving the recently introduced Common Solutions to Variational Inequalities Problem (CSVIP). For simplicity, we mainly confine our attention to…

Optimization and Control · Mathematics 2012-02-06 Yair Censor , Aviv Gibali , Simeon Reich

Science and engineering problems subject to uncertainty are frequently both computationally expensive and feature nonsmooth parameter dependence, making standard Monte Carlo too slow, and excluding efficient use of accelerated uncertainty…

Numerical Analysis · Mathematics 2021-10-01 Per Pettersson , Sebastian Krumscheid

We present a novel method for mixed-integer optimization problems with multivariate and Lipschitz continuous nonlinearities. In particular, we do not assume that the nonlinear constraints are explicitly given but that we can only evaluate…

Optimization and Control · Mathematics 2023-03-22 Julia Grübel , Richard Krug , Martin Schmidt , Winnifried Wollner

Detectability of failures of linear programming (LP) decoding and the potential for improvement by adding new constraints motivate the use of an adaptive approach in selecting the constraints for the underlying LP problem. In this paper, we…

Information Theory · Computer Science 2007-07-13 Mohammad H. Taghavi , Paul H. Siegel