English
Related papers

Related papers: Oracles & Followers: Stackelberg Equilibria in Dee…

200 papers

We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We seek to design strategies for the learner to successfully interact with the opponent. While most previous…

Machine Learning · Computer Science 2020-07-13 Pier Giuseppe Sessa , Ilija Bogunovic , Maryam Kamgarpour , Andreas Krause

Macroeconomic outcomes emerge from individuals' decisions, making it essential to model how agents interact with macro policy via consumption, investment, and labor choices. We formulate this as a dynamic Stackelberg game: the government…

Theoretical Economics · Economics 2025-06-03 Qirui Mi , Zhiyu Zhao , Chengdong Ma , Siyu Xia , Yan Song , Mengyue Yang , Jun Wang , Haifeng Zhang

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

Reinforcement learning (RL) approaches can illuminate emergent behaviors that facilitate coordination across teams of agents as part of a multi-agent system (MAS), which can provide windows of opportunity in various military tasks.…

This paper addresses a Stackelberg stochastic linear-quadratic (LQ) differential game under closed-loop information, a problem inherently time-inconsistent. Existing approaches rely on solving two coupled Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2026-04-27 Qi Lü , Bowen Ma , Hanxiao Wang

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

Multiagent Systems · Computer Science 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher

The paper presents a new method for approximating Strong Stackelberg Equilibrium in general-sum sequential games with imperfect information and perfect recall. The proposed approach is generic as it does not rely on any specific properties…

Computer Science and Game Theory · Computer Science 2022-08-16 Jan Karwowski , Jacek Mańdziuk

Multi-agent reinforcement learning (MARL) extends (single-agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems…

Multiagent Systems · Computer Science 2019-09-12 Yilun Zhou , Derrik E. Asher , Nicholas R. Waytowich , Julie A. Shah

This paper examines the tactical interaction between drones and tanks in modern warfare through game theory, particularly focusing on Stackelberg equilibrium and backward induction. It describes a high-stakes conflict between two teams: one…

Computer Science and Game Theory · Computer Science 2025-06-10 Azhar Iqbal , Ishan Honhaga , Eyoel Teffera , Anthony Perry , Robin Baker , Glenn Pearce , Claudia Szabo

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

Delays are inherent to most dynamical systems. Besides shifting the process in time, they can significantly affect their performance. For this reason, it is usually valuable to study the delay and account for it. Because they are dynamical…

Machine Learning · Computer Science 2023-09-21 Pierre Liotet

A multiagent sequential decision problem has been seen in many critical applications including urban transportation, autonomous driving cars, military operations, etc. Its widely known solution, namely multiagent reinforcement learning, has…

Artificial Intelligence · Computer Science 2024-10-29 Yanyu Liu , Yinghui Pan , Yifeng Zeng , Biyang Ma , Doshi Prashant

In this work we propose a reinforcement learning (RL) framework that controls the density of a large-scale swarm for engaging with adversarial swarm attacks. Although there is a significant amount of existing work in applying artificial…

Robotics · Computer Science 2022-10-18 Umut Demir , Nazim Kemal Ure

Deep Reinforcement Learning (DRL) has been applied to address a variety of cooperative multi-agent problems with either discrete action spaces or continuous action spaces. However, to the best of our knowledge, no previous work has ever…

Machine Learning · Computer Science 2019-06-04 Haotian Fu , Hongyao Tang , Jianye Hao , Zihan Lei , Yingfeng Chen , Changjie Fan

We examine five setups where an agent (or two agents) seeks to explore unknown environment without any prior information. Although seemingly very different, all of them can be formalized as Reinforcement Learning (RL) problems in hyperbolic…

Machine Learning · Computer Science 2024-10-15 Vladimir Jaćimović , Zinaid Kapić , Aladin Crnkić

Stackelberg Security Games (SSGs) have been adopted widely for modeling adversarial interactions. With increasing size of the applications of SSGs, scalability of equilibrium computation is an important research problem. While prior…

Computer Science and Game Theory · Computer Science 2017-11-15 Arunesh Sinha , Aaron Schlenker , Donnabell Dmello , Milind Tambe

Equilibrium refinements are important in extensive-form (i.e., tree-form) games, where they amend weaknesses of the Nash equilibrium concept by requiring sequential rationality and other beneficial properties. One of the most attractive…

Computer Science and Game Theory · Computer Science 2018-11-12 Alberto Marchesi , Gabriele Farina , Christian Kroer , Nicola Gatti , Tuomas Sandholm

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

Computer Science and Game Theory · Computer Science 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Alois Knoll , Ming Jin

Algorithms for playing in Stackelberg games have been deployed in real-world domains including airport security, anti-poaching efforts, and cyber-crime prevention. However, these algorithms often fail to take into consideration the…

Computer Science and Game Theory · Computer Science 2024-10-15 Keegan Harris , Zhiwei Steven Wu , Maria-Florina Balcan