English
Related papers

Related papers: Policy Iteration for Two-Player General-Sum Stocha…

200 papers

Efficient coordination in multi-agent systems often incurs high communication overhead or slow convergence rates, making scalable welfare optimization difficult. We propose Single-Bit Coordination Dynamics for Pareto-Efficient Outcomes…

Computer Science and Game Theory · Computer Science 2025-11-20 Seref Taha Kiremitci , Ahmed Said Donmez , Muhammed O. Sayin

In this study, we explore the application of game theory, in particular Stackelberg games, to address the issue of effective coordination strategy generation for heterogeneous robots with one-way communication. To that end, focusing on the…

Robotics · Computer Science 2023-08-01 Yuhan Zhao , Baichuan Huang , Jingjin Yu , Quanyan Zhu

In this work, we use a Stackelberg infinite discrete-time dynamic game model to study the optimal supply schedule and the optimal demand response under a market-driven dynamic price. A two-layer optimization framework is established. At the…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Yunhan Huang

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

Computer Science and Game Theory · Computer Science 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li

Sequential allocation is a simple mechanism for sharing multiple indivisible items. We study strategic behavior in sequential allocation. In particular, we consider Nash dynamics, as well as the computation and Pareto optimality of pure…

Computer Science and Game Theory · Computer Science 2017-05-29 Haris Aziz , Paul Goldberg , Toby Walsh

The Team Orienteering Problem (TOP) generalizes many real-world multi-robot scheduling and routing tasks that occur in autonomous mobility, aerial logistics, and surveillance applications. While many flavors of the TOP exist for planning in…

Robotics · Computer Science 2025-10-29 Malintha Fernando , Petter Ögren , Silun Zhang

In this paper, we propose a hierarchical game approach to model the energy efficiency maximization problem where transmitters individually choose their channel assignment and power control. We conduct a thorough analysis of the existence,…

Information Theory · Computer Science 2016-11-15 Majed Haddad , Piotr Wiecek , Oussama Habachi , Yezekael Hayel

We study the problem of characterizing optimal learning algorithms for playing repeated games against an adversary with unknown payoffs. In this problem, the first player (called the learner) commits to a learning algorithm against a second…

Computer Science and Game Theory · Computer Science 2024-02-16 Eshwar Ram Arunachaleswaran , Natalie Collina , Jon Schneider

Reinforcement learning has been successful both empirically and theoretically in single-agent settings, but extending these results to multi-agent reinforcement learning in general-sum Markov games remains challenging. This paper studies…

Machine Learning · Computer Science 2026-04-07 Narim Jeong , Donghwan Lee

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computational Complexity · Computer Science 2022-07-21 Tobias Winkler , Maximilian Weininger

We study strategy improvement algorithms for solving parity games. While these algorithms are known to solve parity games using a very small number of iterations, experimental studies have found that a high step complexity causes them to…

Data Structures and Algorithms · Computer Science 2017-05-08 John Fearnley

We study Stackelberg (leader--follower) tuning of network parameters (tolls, capacities, incentives) in combinatorial congestion games, where selfish users choose discrete routes (or other combinatorial strategies) and settle at a…

Computer Science and Game Theory · Computer Science 2026-02-27 Saeed Masiha , Sepehr Elahi , Negar Kiyavash , Patrick Thiran

We present a resource-planning game for cyber-security of networked control systems (NCS). The NCS is assumed to be operating in closed-loop using a linear state-feedback $\mathcal{H}_2$ controller. A zero-sum, two-player Stackelberg game…

Optimization and Control · Mathematics 2022-08-26 Pratishtha Shukla , Lu An , Aranya Chakrabortty , Alexandra Duel-Hallen

Two-player complete-information game trees are perhaps the simplest possible setting for studying general-sum games and the computational problem of finding equilibria. These games admit a simple bottom-up algorithm for finding subgame…

Computer Science and Game Theory · Computer Science 2012-07-02 Michael L. Littman , Nishkam Ravi , Arjun Talwar , Martin Zinkevich

We study policy optimization algorithms for computing correlated equilibria in multi-player general-sum Markov Games. Previous results achieve $O(T^{-1/2})$ convergence rate to a correlated equilibrium and an accelerated $O(T^{-3/4})$…

Machine Learning · Computer Science 2024-05-03 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

In this paper,we mainly focus on the numerical solution of high-dimensional stochastic optimal control problem driven by fully-coupled forward-backward stochastic differential equations (FBSDEs in short) through deep learning. We first…

Optimization and Control · Mathematics 2024-08-21 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

We discuss an open-loop backward Stackelberg differential game involving single leader and single follower. Unlike most Stackelberg game literature, the state to be controlled is characterized by a backward stochastic differential equation…

Optimization and Control · Mathematics 2021-04-06 Xinwei Feng , Ying Hu , Jianhui Huang

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computer Science and Game Theory · Computer Science 2021-09-20 Tobias Winkler , Maximilian Weininger

This work considers a stochastic Nash game in which each player solves a parameterized stochastic optimization problem. In deterministic regimes, best-response schemes have been shown to be convergent under a suitable spectral property…

Optimization and Control · Mathematics 2018-02-08 Jinlong Lei , Uday V. Shanbhag , Jong-Shi Pang , Suvrajeet Sen

Strategic interaction in congested systems is commonly modelled using Stackelberg games, where competing leaders anticipate the behaviour of self-interested followers. A key limitation of existing models is that they typically ignore agents…

Multiagent Systems · Computer Science 2026-03-06 Niloofar Aminikalibar , Farzaneh Farhadi , Maria Chli