English
Related papers

Related papers: Barriers to Welfare Maximization with No-Regret Le…

200 papers

We consider a wireless communication system in which $N$ transmitter-receiver pairs want to communicate with each other. Each transmitter transmits data at a certain rate using a power that depends on the channel gain to its receiver. If a…

Information Theory · Computer Science 2016-02-04 Krishna Chaitanya A , Vinod Sharma , Utpal Mukherji

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2015-03-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

This paper studies a variant of two-player zero-sum matrix games, where, at each timestep, the row player selects row $i$, the column player selects column $j$, and the row player receives a noisy reward with expected value $A_{i,j}$, along…

Machine Learning · Computer Science 2025-05-27 Arnab Maiti , Kevin Jamieson , Lillian J. Ratliff

The theory of reinforcement learning has focused on two fundamental problems: achieving low regret, and identifying $\epsilon$-optimal policies. While a simple reduction allows one to apply a low-regret algorithm to obtain an…

Machine Learning · Computer Science 2022-06-23 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

We study online learning and equilibrium computation in games with polyhedral decision sets, a property shared by both normal-form games and extensive-form games (EFGs), when the learning agent is restricted to using a best-response oracle.…

Computer Science and Game Theory · Computer Science 2023-12-07 Darshan Chakrabarti , Gabriele Farina , Christian Kroer

We show that natural classes of regularized learning algorithms with a form of recency bias achieve faster convergence rates to approximate efficiency and to coarse correlated equilibria in multiplayer normal form games. When each player in…

Computer Science and Game Theory · Computer Science 2015-12-14 Vasilis Syrgkanis , Alekh Agarwal , Haipeng Luo , Robert E. Schapire

We consider the capacitated selfish replication (CSR) game with binary preferences, over general undirected networks. We first show that such games have an associated ordinary potential function, and hence always admit a pure-strategy Nash…

Computer Science and Game Theory · Computer Science 2016-03-14 Seyed Rasoul Etesami , Tamer Basar

We consider the problem of learning to play a repeated contextual game with unknown reward and unknown constraints functions. Such games arise in applications where each agent's action needs to belong to a feasible set, but the feasible set…

Computer Science and Game Theory · Computer Science 2024-05-27 Anna M. Maddux , Maryam Kamgarpour

A considerable chasm has been looming for decades between theory and practice in zero-sum game solving through first-order methods. Although a convergence rate of $T^{-1}$ has long been established, the most effective paradigm in practice…

Computer Science and Game Theory · Computer Science 2026-02-18 Brian Hu Zhang , Ioannis Anagnostides , Tuomas Sandholm

A line of recent work provides welfare guarantees of simple combinatorial auction formats, such as selling m items via simultaneous second price auctions (SiSPAs) (Christodoulou et al. 2008, Bhawalkar and Roughgarden 2011, Feldman et al.…

Computer Science and Game Theory · Computer Science 2016-04-07 Constantinos Daskalakis , Vasilis Syrgkanis

We study the problem of finding optimal correlated equilibria of various sorts in extensive-form games: normal-form coarse correlated equilibrium (NFCCE), extensive-form coarse correlated equilibrium (EFCCE), and extensive-form correlated…

Computer Science and Game Theory · Computer Science 2025-01-28 Brian Zhang , Gabriele Farina , Andrea Celli , Tuomas Sandholm

The Certainty Equivalent heuristic (CE) is a widely-used algorithm for various dynamic resource allocation problems in OR and OM. Despite its popularity, existing theoretical guarantees of CE are limited to settings satisfying restrictive…

Optimization and Control · Mathematics 2025-02-14 Yilun Chen , Wenjia Wang

We study the problem of learning in zero-sum matrix games with repeated play and bandit feedback. Specifically, we focus on developing uncoupled algorithms that guarantee, without communication between players, the convergence of the…

Machine Learning · Computer Science 2026-04-20 Côme Fiegel , Pierre Ménard , Tadashi Kozuno , Michal Valko , Vianney Perchet

We study fast rates of convergence in the setting of nonparametric online regression, namely where regret is defined with respect to an arbitrary function class which has bounded complexity. Our contributions are two-fold: - In the…

Machine Learning · Computer Science 2022-04-13 Constantinos Daskalakis , Noah Golowich

Swap regret is a notion that has proven itself to be central to the study of general-sum normal-form games, with swap-regret minimization leading to convergence to the set of correlated equilibria and guaranteeing non-manipulability against…

Computer Science and Game Theory · Computer Science 2025-02-28 Eshwar Ram Arunachaleswaran , Natalie Collina , Yishay Mansour , Mehryar Mohri , Jon Schneider , Balasubramanian Sivan

We propose efficient no-regret learning dynamics and ellipsoid-based methods for computing linear correlated equilibria$\unicode{x2014}$a relaxation of correlated equilibria and a strengthening of coarse correlated…

Computer Science and Game Theory · Computer Science 2024-12-31 Constantinos Daskalakis , Gabriele Farina , Maxwell Fishelson , Charilaos Pipis , Jon Schneider

We study techniques to incentivize self-interested agents to form socially desirable solutions in scenarios where they benefit from mutual coordination. Towards this end, we consider coordination games where agents have different intrinsic…

Computer Science and Game Theory · Computer Science 2014-04-21 Elliot Anshelevich , Shreyas Sekar

This paper examines the long-run behavior of learning with bandit feedback in non-cooperative concave games. The bandit framework accounts for extremely low-information environments where the agents may not even know they are playing a…

Computer Science and Game Theory · Computer Science 2018-10-05 Mario Bravo , David S. Leslie , Panayotis Mertikopoulos

We study $n$-player turn-based games played on a finite directed graph. For each play, the players have to pay a cost that they want to minimize. Instead of the well-known notion of Nash equilibrium (NE), we focus on the notion of subgame…

Computer Science and Game Theory · Computer Science 2015-04-13 Thomas Brihaye , Véronique Bruyère , Noémie Meunier , Jean-François Raskin

The interplay between exploration and exploitation in competitive multi-agent learning is still far from being well understood. Motivated by this, we study smooth Q-learning, a prototypical learning model that explicitly captures the…

Computer Science and Game Theory · Computer Science 2021-06-25 Stefanos Leonardos , Georgios Piliouras , Kelly Spendlove