中文
相关论文

相关论文: When is Momentum Extragradient Optimal? A Polynomi…

200 篇论文

In this paper, we study multi-agent network games subject to affine time-varying coupling constraints and a time-varying communication network. We focus on the class of games adopting proximal dynamics and study their convergence to a…

计算机科学与博弈论 · 计算机科学 2019-11-20 Carlo Cenedese , Giuseppe Belgioioso , Sergio Grammatico , Ming Cao

We study online optimization methods for zero-sum games, a fundamental problem in adversarial learning in machine learning, economics, and many other domains. Traditional methods approximate Nash equilibria (NE) using either regret-based…

计算机科学与博弈论 · 计算机科学 2025-07-16 Taemin Kim , James P. Bailey

This work proposes a novel distributed approach for computing a Nash equilibrium in convex games with restricted strongly monotone pseudo-gradients. By leveraging the idea of the centralized operator extrapolation method presented in [4] to…

最优化与控制 · 数学 2023-10-25 Tatiana Tatarenko , Angelia Nedich

We present a new family of min-max optimization algorithms that automatically exploit the geometry of the gradient data observed at earlier iterations to perform more informative extra-gradient steps in later ones. Thanks to this adaptation…

最优化与控制 · 数学 2020-11-20 Kimon Antonakopoulos , E. Veronica Belmega , Panayotis Mertikopoulos

We propose a new method to accelerate the convergence of optimization algorithms. This method simply adds a power coefficient $\gamma\in[0,1)$ to the gradient during optimization. We call this the Powerball method and analyze the…

系统与控制 · 计算机科学 2019-09-24 Ye Yuan , Mu Li , Jun Liu , Claire J. Tomlin

In decision-dependent games, multiple players optimize their decisions under a data distribution that shifts with their joint actions, creating complex dynamics in applications like market pricing. A practical consequence of these dynamics…

计算机科学与博弈论 · 计算机科学 2025-09-04 Guangzheng Zhong , Yang Liu , Jiming Liu

We investigate the computation of equilibria in extensive-form games where ex ante correlation is possible, focusing on correlated equilibria requiring the least amount of communication between the players and the mediator. Motivated by the…

计算机科学与博弈论 · 计算机科学 2019-01-21 Andrea Celli , Stefano Coniglio , Nicola Gatti

Adaptive momentum methods have recently attracted a lot of attention for training of deep neural networks. They use an exponential moving average of past gradients of the objective function to update both search directions and learning…

最优化与控制 · 数学 2021-04-27 Babak Barazandeh , Davoud Ataee Tarzanagh , George Michailidis

We study the convergence of Optimistic Gradient Descent Ascent in unconstrained bilinear games. In a first part, we consider the zero-sum case and extend previous results by Daskalakis et al. in 2018, Liang and Stokes in 2019, and others:…

最优化与控制 · 数学 2022-11-24 Étienne de Montbrun , Jérôme Renault

Minimax problems are notoriously challenging to optimize. However, we present that the two-timescale extragradient method can be a viable solution. By utilizing dynamical systems theory, we show that it converges to points that satisfy the…

最优化与控制 · 数学 2024-04-23 Jiseok Chae , Kyuwon Kim , Donghwan Kim

In this paper we study two-player bilinear zero-sum games with constrained strategy spaces. An instance of natural occurrences of such constraints is when mixed strategies are used, which correspond to a probability simplex constraint. We…

计算机科学与博弈论 · 计算机科学 2022-06-10 Andre Wibisono , Molei Tao , Georgios Piliouras

The performance of numerical micromagnetic models is limited by the demagnetizing field computation, which typically accounts for the majority of the computation time. For magnetization dynamics simulations explicit evaluation methods are…

计算物理 · 物理学 2022-06-15 Serban Lepadatu

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

最优化与控制 · 数学 2015-11-10 Dang Van Hieu

The rapid progress in machine learning in recent years has been based on a highly productive connection to gradient-based optimization. Further progress hinges in part on a shift in focus from pattern recognition to decision-making and…

机器学习 · 计算机科学 2024-02-27 Neha S. Wadia , Yatin Dandi , Michael I. Jordan

In this paper, we generalize the classical extragradient algorithm for solving variational inequality problems by utilizing nonzero normal vectors of the feasible set. In particular, conceptual algorithms are proposed with two different…

最优化与控制 · 数学 2019-02-25 J. Y. Bello Cruz , R. Díaz Millán , Hung M. Phan

We consider infinite duration alternating move games. These games were previously studied by Roth, Balcan, Kalai and Mansour. They presented an FPTAS for computing an approximated equilibrium, and conjectured that there is a polynomial…

计算机科学与博弈论 · 计算机科学 2013-04-25 Yaron Velner

This work focuses on the fulfillment of the Persistent Excitation (PE) condition for signals which result from transformations by means of polynomials. This is essential e.g. for the convergence of Adaptive Dynamic Programming algorithms…

最优化与控制 · 数学 2022-01-21 Philipp Karg , Florian Köpf , Christian A. Braun , Sören Hohmann

This work proposes a novel distributed approach for computing a Nash equilibrium in convex games with merely monotone and restricted strongly monotone pseudo-gradients. By leveraging the idea of the centralized operator extrapolation method…

最优化与控制 · 数学 2025-07-18 Tatiana Tatarenko , Angelia Nedich

Aiming to provide a new class of game dynamics with good long-term rationality properties, we derive a second-order inertial system that builds on the widely studied "heavy ball with friction" optimization method. By exploiting a well-known…

最优化与控制 · 数学 2015-03-03 Rida Laraki , Panayotis Mertikopoulos

This paper reviews gradient-based techniques to solve bilevel optimization problems. Bilevel optimization is a general way to frame the learning of systems that are implicitly defined through a quantity that they minimize. This…

机器学习 · 计算机科学 2023-05-26 Nicolas Zucchet , João Sacramento