English
Related papers

Related papers: Accelerating Smooth Games by Manipulating Spectral…

200 papers

Mini-batch algorithms have been proposed as a way to speed-up stochastic convex optimization problems. We study how such algorithms can be improved using accelerated gradient methods. We provide a novel analysis, which shows how standard…

Machine Learning · Computer Science 2011-06-24 Andrew Cotter , Ohad Shamir , Nathan Srebro , Karthik Sridharan

The complexity of computing equilibrium refinements has been at the forefront of algorithmic game theory research, but it has remained open in the seminal class of potential games; we close this fundamental gap in this paper. We first show…

Computer Science and Game Theory · Computer Science 2026-02-11 Ioannis Anagnostides , Maria-Florina Balcan , Kiriaki Fragkia , Tuomas Sandholm , Emanuel Tewolde , Brian Hu Zhang

We study the problem of characterizing the set of games that are consistent with observed equilibrium play. Our contribution is to develop and analyze a new methodology based on convex optimization to address this problem for many classes…

Computer Science and Game Theory · Computer Science 2017-03-23 Juba Ziani , Venkat Chandrasekaran , Katrina Ligett

Dynamic game theory offers a toolbox for formalizing and solving for both cooperative and non-cooperative strategies in multi-agent scenarios. However, the optimal configuration of such games remains largely unexplored. While there is…

Multiagent Systems · Computer Science 2025-08-18 Jesse Milzman , Jeffrey Mao , Giuseppe Loianno

We suggest simple implementable modifications of conditional gradient and gradient projection methods for smooth convex optimization problems in Hilbert spaces. Usually, the custom methods attain only weak convergence. We prove strong…

Optimization and Control · Mathematics 2017-05-04 Igor Konnov

The conjugate gradient method is a widely used algorithm for the numerical solution of a system of linear equations. It is particularly attractive because it allows one to take advantage of sparse matrices and produces (in case of infinite…

Numerical Analysis · Mathematics 2017-11-27 Sergey Voronin , Christophe Zaroli , Naresh P. Cuntoor

Worst-case hardness results for most equilibrium computation problems have raised the need for beyond-worst-case analysis. To this end, we study the smoothed complexity of finding pure Nash equilibria in Network Coordination Games, a…

Computational Complexity · Computer Science 2019-02-27 Shant Boodaghians , Rucha Kulkarni , Ruta Mehta

Stackelberg games have been widely used to model interactive decision-making problems in a variety of domains such as energy systems, transportation, cybersecurity, and human-robot interaction. However, existing algorithms for solving…

Optimization and Control · Mathematics 2023-03-14 Yansong Li , Shuo Han

Aiming to provide a new class of game dynamics with good long-term rationality properties, we derive a second-order inertial system that builds on the widely studied "heavy ball with friction" optimization method. By exploiting a well-known…

Optimization and Control · Mathematics 2015-03-03 Rida Laraki , Panayotis Mertikopoulos

In smooth strongly convex optimization, knowledge of the strong convexity parameter is critical for obtaining simple methods with accelerated rates. In this work, we study a class of methods, based on Polyak steps, where this knowledge is…

Optimization and Control · Mathematics 2020-07-06 Mathieu Barré , Adrien Taylor , Alexandre d'Aspremont

Cooperative games are an important class of problems in game theory, where the goal is to distribute a value among a set of players who are allowed to cooperate by forming coalitions. An outcome of the game is given by an allocation vector…

Computer Science and Game Theory · Computer Science 2019-06-07 Zhuan Khye Koh , Laura Sanità

In this work, we study the computational complexity of reducing the squared gradient magnitude for smooth minimax optimization problems. First, we present algorithms with accelerated $\mathcal{O}(1/k^2)$ last-iterate rates, faster than the…

Optimization and Control · Mathematics 2021-06-11 TaeHo Yoon , Ernest K. Ryu

We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either…

Optimization and Control · Mathematics 2024-06-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

We revisit the coalition structure generation problem in which the goal is to partition the players into exhaustive and disjoint coalitions so as to maximize the social welfare. One of our key results is a general polynomial-time algorithm…

Computer Science and Game Theory · Computer Science 2011-06-21 Haris Aziz , Bart de Keijzer

We give a new algorithm for Unique Games which is based on purely {\em spectral} techniques, in contrast to previous work in the area, which relies heavily on semidefinite programming (SDP). Given a highly satisfiable instance of Unique…

Computational Complexity · Computer Science 2011-02-14 Alexandra Kolla

Matrix games constitute a fundamental problem of game theory and describe a situation of two players with completely conflicting interests. We show how methods from statistical mechanics can be used to investigate the statistical properties…

Disordered Systems and Neural Networks · Physics 2009-10-31 J. Berg , A. Engel

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known as implicit bias, plays a critical role in…

Machine Learning · Computer Science 2024-04-09 Guanghui Wang , Zihao Hu , Claudio Gentile , Vidya Muthukumar , Jacob Abernethy

Binary optimization is a powerful tool for modeling combinatorial problems, yet scalable and theoretically sound solution methods remain elusive. Conventional solvers often rely on heuristic strategies with weak guarantees or struggle with…

Optimization and Control · Mathematics 2026-05-12 Wenbo Liu , Akang Wang , Dun Ma , Hongyi Jiang , Jianghua Wu , Wenguo Yang

Finding the optimal hyperparameters of a model can be cast as a bilevel optimization problem, typically solved using zero-order techniques. In this work we study first-order methods when the inner optimization problem is convex but…