English
Related papers

Related papers: Steering No-Regret Learners to a Desired Equilibri…

200 papers

We consider the problem of decentralized multi-agent reinforcement learning in Markov games. A fundamental question is whether there exist algorithms that, when adopted by all agents and run independently in a decentralized fashion, lead to…

Machine Learning · Computer Science 2023-03-23 Dylan J. Foster , Noah Golowich , Sham M. Kakade

We study repeated two-player games where one of the players, the learner, employs a no-regret learning strategy, while the other, the optimizer, is a rational utility maximizer. We consider general Bayesian games, where the payoffs of both…

Machine Learning · Computer Science 2022-05-19 Yishay Mansour , Mehryar Mohri , Jon Schneider , Balasubramanian Sivan

A recent line of work has established uncoupled learning dynamics such that, when employed by all players in a game, each player's \emph{regret} after $T$ repetitions grows polylogarithmically in $T$, an exponential improvement over the…

Computer Science and Game Theory · Computer Science 2022-10-18 Gabriele Farina , Ioannis Anagnostides , Haipeng Luo , Chung-Wei Lee , Christian Kroer , Tuomas Sandholm

This paper studies a dynamic discrete-time queuing model where at every period players get a new job and must send all their jobs to a queue that has a limited capacity. Players have an incentive to send their jobs as late as possible;…

Computer Science and Game Theory · Computer Science 2023-02-08 Lucas Baudin , Marco Scarsini , Xavier Venel

In many applications, we want to influence the decisions of independent agents by designing incentives for their actions. We revisit a fundamental problem in this area, called GAME IMPLEMENTATION: Given a game in standard form and a set of…

Computer Science and Game Theory · Computer Science 2022-12-02 Jiehua Chen , Sebastian Vincent Haydn , Negar Layegh Khavidaki , Sofia Simola , Manuel Sorge

Hindsight rationality is an approach to playing general-sum games that prescribes no-regret learning dynamics for individual agents with respect to a set of deviations, and further describes jointly rational behavior among multiple agents…

Computer Science and Game Theory · Computer Science 2022-06-03 Dustin Morrill , Ryan D'Orazio , Marc Lanctot , James R. Wright , Michael Bowling , Amy R. Greenwald

We study online learning in Bayesian Stackelberg games, where a leader repeatedly interacts with a follower whose unknown private type is independently drawn at each round from an unknown probability distribution. The goal is to design…

Computer Science and Game Theory · Computer Science 2026-02-03 Matteo Bollini , Francesco Bacchiocchi , Samuel Coutts , Matteo Castiglioni , Alberto Marchesi

We study the repeated optimal stopping problem, in which the same optimal stopping instance with an unknown distribution is solved repeatedly over $T$ rounds. We aim to simultaneously achieve strong per-round performance guarantees relative…

Data Structures and Algorithms · Computer Science 2026-05-18 Tsubasa Harada , Yasushi Kawase , Hanna Sumita

Motivated by online retail, we consider the problem of selling one item (e.g., an ad slot) to two non-excludable buyers (say, a merchant and a brand). This problem captures, for example, situations where a merchant and a brand cooperatively…

Computer Science and Game Theory · Computer Science 2025-05-26 Gagan Aggarwal , Ashwinkumar Badanidiyuru , Paul Dütting , Federico Fusco

In many social dilemmas, individuals tend to generate a situation with low payoffs instead of a system optimum ("tragedy of the commons"). Is the routing of traffic a similar problem? In order to address this question, we present…

Physics and Society · Physics 2007-05-23 Dirk Helbing , Martin Schonhof , Hans-Ulrich Stark , Janusz A. Holyst

A recent paper by Farina & Pipis (2023) established the existence of uncoupled no-linear-swap regret dynamics with polynomial-time iterations in extensive-form games. The equilibrium points reached by these dynamics, known as linear…

Computer Science and Game Theory · Computer Science 2024-03-19 Brian Hu Zhang , Gabriele Farina , Tuomas Sandholm

The extensive-form game has been studied considerably in recent years. It can represent games with multiple decision points and incomplete information, and hence it is helpful in formulating games with uncertain inputs, such as poker. We…

Computer Science and Game Theory · Computer Science 2023-03-21 Keigo Habara , Ellen Hidemi Fukuda , Nobuo Yamashita

This paper introduces the new concept of (follower) satisfaction in Stackelberg games and compares the standard Stackelberg game with its satisfaction version. Simulation results are presented which suggest that the follower adopting…

Computer Science and Game Theory · Computer Science 2024-08-22 Langford White , Duong Nguyen , Hung Nguyen

In the standard setting of approachability there are two players and a target set. The players play repeatedly a known vector-valued game where the first player wants to have the average vector-valued payoff converge to the target set which…

Machine Learning · Statistics 2016-06-20 Shie Mannor , Vianney Perchet , Gilles Stoltz

Hindsight rationality is an approach to playing general-sum games that prescribes no-regret learning dynamics for individual agents with respect to a set of deviations, and further describes jointly rational behavior among multiple agents…

Computer Science and Game Theory · Computer Science 2022-06-24 Dustin Morrill , Ryan D'Orazio , Marc Lanctot , James R. Wright , Michael Bowling , Amy Greenwald

In this paper, a new method is proposed to compute the rolling Nash equilibrium of the time-invariant nonlinear two-person zero-sum differential games. The idea is to discretize the time to transform a differential game into a sequential…

Systems and Control · Electrical Eng. & Systems 2020-11-13 Wei Liao , Xiaohui Wei , Jizhou Lai

Steering vectors are a lightweight method for controlling language model behavior by adding a learned bias to the activations at inference time. Although effective on average, steering effect sizes vary across samples and are unreliable for…

Computation and Language · Computer Science 2026-02-23 Joschka Braun

Our paper studies the setting of players using no-regret algorithms in various two-player games. We address whether having stronger regret guarantees or playing against an opponent with weaker regret guarantees yields higher utilities for…

Computer Science and Game Theory · Computer Science 2026-04-29 R. Xu , E. Yachbes , J. Zhang

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

Computer Science and Game Theory · Computer Science 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

An abundance of recent impossibility results establish that regret minimization in Markov games with adversarial opponents is both statistically and computationally intractable. Nevertheless, none of these results preclude the possibility…

Machine Learning · Computer Science 2025-06-17 Liad Erez , Tal Lancewicki , Uri Sherman , Tomer Koren , Yishay Mansour