English
Related papers

Related papers: Learning Local Stackelberg Equilibria from Repeate…

200 papers

Stochastic dynamic teams and games are rich models for decentralized systems and challenging testing grounds for multi-agent learning. Previous work that guaranteed team optimality assumed stateless dynamics, or an explicit coordination…

Optimization and Control · Mathematics 2024-03-28 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

Batch reinforcement learning (RL) defines the task of learning from a fixed batch of data lacking exhaustive exploration. Worst-case optimality algorithms, which calibrate a value-function model class from logged experience and perform some…

Machine Learning · Statistics 2023-10-03 Wenzhuo Zhou , Annie Qu

Principal-agent problems arise when one party acts on behalf of another, leading to conflicts of interest. The economic literature has extensively studied principal-agent problems, and recent work has extended this to more complex scenarios…

Artificial Intelligence · Computer Science 2024-01-02 Omer Ben-Porat , Yishay Mansour , Michal Moshkovitz , Boaz Taitler

We initiate the study of game dynamics in the population protocol model: $n$ agents each maintain a current local strategy and interact in pairs uniformly at random. Upon each interaction, the agents play a two-person game and receive a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Dan Alistarh , Krishnendu Chatterjee , Mehrdad Karrabi , John Lazarsfeld

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Seamlessly interacting with humans or robots is hard because these agents are non-stationary. They update their policy in response to the ego agent's behavior, and the ego agent must anticipate these changes to co-adapt. Inspired by humans,…

Robotics · Computer Science 2020-11-16 Annie Xie , Dylan P. Losey , Ryan Tolsma , Chelsea Finn , Dorsa Sadigh

Multi-agent LLM systems enable advanced reasoning and tool use via role specialization, yet reliable reinforcement learning (RL) post-training for such systems remains difficult. In this work, we theoretically pinpoint a key reason for…

Machine Learning · Computer Science 2026-02-10 Lang Feng , Longtao Zheng , Shuo He , Fuxiang Zhang , Bo An

We present a fully polynomial-time approximation scheme (FPTAS) for computing equilibria in congestion games, under smoothed running-time analysis. More precisely, we prove that if the resource costs of a congestion game are randomly…

Computer Science and Game Theory · Computer Science 2024-05-21 Yiannis Giannakopoulos

We consider infinite duration alternating move games. These games were previously studied by Roth, Balcan, Kalai and Mansour. They presented an FPTAS for computing an approximated equilibrium, and conjectured that there is a polynomial…

Computer Science and Game Theory · Computer Science 2013-04-25 Yaron Velner

We consider quadratic, nonmonotone generalized Nash equilibrium problems with symmetric interactions among the agents. Albeit this class of games is known to admit a potential function, its formal expression can be unavailable in several…

Optimization and Control · Mathematics 2022-03-31 Filippo Fabiani , Andrea Simonetto , Paul J. Goulart

Aligning AI systems with human values remains a fundamental challenge, but does our inability to create perfectly aligned models preclude obtaining the benefits of alignment? We study a strategic setting where a human user interacts with…

Machine Learning · Computer Science 2026-02-04 Natalie Collina , Surbhi Goel , Aaron Roth , Emily Ryu , Mirah Shi

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

Machine Learning · Computer Science 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

Realtime environments change even as agents perform action inference and learning, thus requiring high interaction frequencies to effectively minimize regret. However, recent advances in machine learning involve larger neural networks with…

Machine Learning · Computer Science 2024-12-20 Matthew Riemer , Gopeshh Subbaraj , Glen Berseth , Irina Rish

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

We study reinforcement learning (RL) in a setting with a network of agents whose states and actions interact in a local manner where the objective is to find localized policies such that the (discounted) global reward is maximized. A…

Optimization and Control · Mathematics 2021-11-02 Guannan Qu , Adam Wierman , Na Li

This paper addresses the challenge of limited observations in non-cooperative multi-agent systems where agents can have partial access to other agents' actions. We present the generalized individual Q-learning dynamics that combine…

Computer Science and Game Theory · Computer Science 2024-09-05 Ahmed Said Donmez , Muhammed O. Sayin

Continual learning is often motivated by the idea, known as the big world hypothesis, that "the world is bigger" than the agent. Recent problem formulations capture this idea by explicitly constraining an agent relative to the environment.…

Artificial Intelligence · Computer Science 2025-12-30 Alex Lewandowski , Adtiya A. Ramesh , Edan Meyer , Dale Schuurmans , Marlos C. Machado

We investigate an algorithm that assigns to any game in normal form an approximating game that admits an ordinal potential function. Due to the properties of potential games, the algorithm equips every game with a surrogate reward structure…

Multiagent Systems · Computer Science 2026-02-24 Philipp Lakheshar , Sharwin Rezagholi

We propose a two-layer, semi-decentralized algorithm to compute a local solution to the Stackelberg equilibrium problem in aggregative games with coupling constraints. Specifically, we focus on a single-leader, multiple-follower problem,…

Optimization and Control · Mathematics 2022-02-17 Filippo Fabiani , Mohammad Amin Tajeddini , Hamed Kebriaei , Sergio Grammatico

One of the proposed solutions to the equilibrium selection problem for agents learning in repeated games is obtained via the notion of stochastic stability. Learning algorithms are perturbed so that the Markov chain underlying the learning…

Computer Science and Game Theory · Computer Science 2012-07-09 John Wicks , Amy Greenwald