English
Related papers

Related papers: Model-free Reinforcement Learning for Stochastic S…

200 papers

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

Machine Learning · Computer Science 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

Leader-follower general-sum stochastic games (LF-GSSGs) model sequential decision-making under asymmetric commitment, where a leader commits to a policy and a follower best responds, yielding a strong Stackelberg equilibrium (SSE) with…

Computer Science and Game Theory · Computer Science 2025-12-08 Jilles Steeve Dibangoye , Thibaut Le Marre , Ocan Sankur , François Schwarzentruber

Autocurricular training is an important sub-area of multi-agent reinforcement learning~(MARL) that allows multiple agents to learn emergent skills in an unsupervised co-evolving scheme. The robotics community has experimented autocurricular…

Artificial Intelligence · Computer Science 2023-05-09 Boling Yang , Liyuan Zheng , Lillian J. Ratliff , Byron Boots , Joshua R. Smith

We study reinforcement learning (RL) for learning a Quantal Stackelberg Equilibrium (QSE) in an episodic Markov game with a leader-follower structure. In specific, at the outset of the game, the leader announces her policy to the follower…

Machine Learning · Computer Science 2023-07-27 Siyu Chen , Mengdi Wang , Zhuoran Yang

Dynamic Stackelberg games are a broad class of two-player games in which the leader acts first, and the follower chooses a response strategy to the leader's strategy. Unfortunately, only stylized Stackelberg games are explicitly solvable…

Optimization and Control · Mathematics 2024-11-15 Guillermo Alvarez , Ibrahim Ekren , Anastasis Kratsios , Xuwei Yang

In this paper, we study a linear-quadratic partially observed Stackelberg stochastic differential game problem in which a single leader and multiple followers are involved. We consider more practical formulation for partial information that…

Optimization and Control · Mathematics 2026-05-14 Yichun Li , Yaozhong Hu , Jingtao Shi , Yueyang Zheng

The Stackelberg game depicts a leader-follower relationship wherein decisions are made sequentially, and the Stackelberg equilibrium represents an expected optimal solution when the leader can anticipate the rational response of the…

Systems and Control · Electrical Eng. & Systems 2024-01-17 Yue Chen , Peng Yi

This paper studies multi-user communication systems with two groups of users: leaders which possess system information, and followers which have no system information using the formulation of Stackelberg games. In such games, the leaders…

Information Theory · Computer Science 2011-08-26 saeedeh parsaeefard , Mihaela van der Schaar , Ahmad R. Sharafat

This paper is concerned with a Stackelberg stochastic differential game with asymmetric noisy observation, with one follower and one leader. In our model, the follower cannot observe the state process directly, but could observe a noisy…

Optimization and Control · Mathematics 2020-07-14 Yueyang Zheng , Jingtao Shi

This paper is concerned with a two-person zero-sum indefinite stochastic linear-quadratic Stackelberg differential game with asymmetric informational uncertainties, where both the leader and follower face different and unknown disturbances.…

Optimization and Control · Mathematics 2024-07-09 Na Xiang , Jingtao Shi

In this paper, we consider a finite horizon, non-stationary, mean field games (MFG) with a large population of homogeneous players, sequentially making strategic decisions, where each player is affected by other players through an aggregate…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

In this paper, we are concerned with the stabilizatbility of Stackelberg game-based systems. In particular, two players are involved in the system where one is the follower to minimize the related cost function and the other is the leader…

Optimization and Control · Mathematics 2021-05-04 Yue Sun , Juanjuan Xu , Huanshui Zhang

We study a Stackelberg variant of the classical discrete-time Dynkin game, in which Player 1 (the leader) commits to a stopping strategy first and Player 2 (the follower) responds optimally. This leader-follower structure induces an optimal…

Optimization and Control · Mathematics 2026-05-26 Jingjie Zhang , Zhou Zhou

Algorithms for playing in Stackelberg games have been deployed in real-world domains including airport security, anti-poaching efforts, and cyber-crime prevention. However, these algorithms often fail to take into consideration the…

Computer Science and Game Theory · Computer Science 2024-10-15 Keegan Harris , Zhiwei Steven Wu , Maria-Florina Balcan

This paper is concerned with a linear-quadratic (LQ) leader-follower differential game with mixed deterministic and stochastic controls. In the game, the follower is a random controller which means that the follower can choose adapted…

Optimization and Control · Mathematics 2025-09-26 Jingtao Shi , Guangchen Wang

Macroeconomic outcomes emerge from individuals' decisions, making it essential to model how agents interact with macro policy via consumption, investment, and labor choices. We formulate this as a dynamic Stackelberg game: the government…

Theoretical Economics · Economics 2025-06-03 Qirui Mi , Zhiyu Zhao , Chengdong Ma , Siyu Xia , Yan Song , Mengyue Yang , Jun Wang , Haifeng Zhang

This paper is concerned with a linear-quadratic partially observed Stackelberg stochastic differential game with correlated state and observation noises, where the diffusion coefficient does not contain the control variable and the control…

Optimization and Control · Mathematics 2021-05-25 Yueyang Zheng , Jingtao Shi

Two-player mean-payoff Stackelberg games are nonzero-sum infinite duration games played on a bi-weighted graph by Leader (Player 0) and Follower (Player 1). Such games are played sequentially: first, Leader announces her strategy, second,…

Optimization and Control · Mathematics 2021-08-04 Mrudula Balachander , Shibashis Guha , Jean-François Raskin

The multilevel reverse Stackelberg game is considered. In this game, the leader controls the outcome by announcing a strategy as a function of decision variables of the followers to his/her own decision space. Corresponding to the leader's…

Optimization and Control · Mathematics 2023-03-01 Seyfe Belete Worku , Birilew Belayneh Tsegaw , Semu Mitiku Kassa

This paper is concerned with the stochastic linear quadratic Stackelberg differential game with overlapping information, where the diffusion terms contain the control and state variables. Here the term "overlapping" means that there are…

Optimization and Control · Mathematics 2018-05-01 Jingtao Shi , Guangchen Wang , Jie Xiong