English
Related papers

Related papers: A non-zero-sum game with reinforcement learning un…

200 papers

This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient…

Optimization and Control · Mathematics 2017-02-17 Yi Zhuang

Modern reinforcement learning (RL) commonly engages practical problems with large state spaces, where function approximation must be deployed to approximate either the value function or the policy. While recent progresses in RL theory…

Machine Learning · Computer Science 2021-10-14 Chi Jin , Qinghua Liu , Tiancheng Yu

We propose a mean field control game model for the intra-and-inter-bank borrowing and lending problem. This framework allows to study the competitive game arising between groups of collaborative banks. The solution is provided in terms of…

Optimization and Control · Mathematics 2022-07-08 Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Laurière , Jimin Lin

We obtain global, non-asymptotic convergence guarantees for independent learning algorithms in competitive reinforcement learning settings with two agents (i.e., zero-sum stochastic games). We consider an episodic setting where in each…

Machine Learning · Computer Science 2021-01-13 Constantinos Daskalakis , Dylan J. Foster , Noah Golowich

We present a new combined \textit{mean field control game} (MFCG) problem which can be interpreted as a competitive game between collaborating groups and its solution as a Nash equilibrium between groups. Players coordinate their strategies…

Optimization and Control · Mathematics 2023-02-16 Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Lauriere , Jimin Lin

We establish a Nash equilibrium in a market with $ N $ agents with the performance criteria of relative wealth level when the market return is unobservable. Each investor has a random prior belief on the return rate of the risky asset. The…

Portfolio Management · Quantitative Finance 2020-07-24 Chao Deng , Xizhi Su , Chao Zhou

We consider a general nonzero-sum impulse game with two players. The main mathematical contribution of the paper is a verification theorem which provides, under some regularity conditions, a suitable system of quasi-variational inequalities…

Probability · Mathematics 2018-11-09 René Aïd , Matteo Basei , Giorgia Callegaro , Luciano Campi , Tiziano Vargiolu

Model-free learning for multi-agent stochastic games is an active area of research. Existing reinforcement learning algorithms, however, are often restricted to zero-sum games, and are applicable only in small state-action spaces or other…

Machine Learning · Computer Science 2022-10-25 Philippe Casgrain , Brian Ning , Sebastian Jaimungal

We study risk-sensitive multi-agent reinforcement learning under general-sum Markov games, where agents optimize the entropic risk measure of rewards with possibly diverse risk preferences. We show that using the regret naively adapted from…

Machine Learning · Computer Science 2024-05-07 Yingjie Fei , Ruitu Xu

Consider a 2-player normal-form game repeated over time. We introduce an adaptive learning procedure, where the players only observe their own realized payoff at each stage. We assume that agents do not know their own payoff function, and…

Computer Science and Game Theory · Computer Science 2013-06-13 Mario Bravo , Mathieu Faure

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

Machine Learning · Computer Science 2023-01-05 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

We study a game between liquidity provider and liquidity taker agents interacting in an over-the-counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions…

Multiagent Systems · Computer Science 2023-08-02 Nelson Vadori , Leo Ardon , Sumitra Ganesh , Thomas Spooner , Selim Amrouni , Jared Vann , Mengda Xu , Zeyu Zheng , Tucker Balch , Manuela Veloso

The application of Reinforcement Learning (RL) to economic modeling reveals a fundamental conflict between the assumptions of equilibrium theory and the emergent behavior of learning agents. While canonical economic models assume atomistic…

General Economics · Economics 2025-10-21 Ruxin Chen , Zeqiang Zhang

This paper studies an optimal investment-consumption problem for competitive agents with exponential or power utilities and a common finite time horizon. Each agent regards the average of habit formation and wealth from all peers as…

Optimization and Control · Mathematics 2024-05-06 Zongxia Liang , Keyu Zhang

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

Optimization and Control · Mathematics 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

We propose a reinforcement learning algorithm for stationary mean-field games, where the goal is to learn a pair of mean-field state and stationary policy that constitutes the Nash equilibrium. When viewing the mean-field state and the…

Machine Learning · Computer Science 2020-10-12 Qiaomin Xie , Zhuoran Yang , Zhaoran Wang , Andreea Minca

Prediction is a well-studied machine learning task, and prediction algorithms are core ingredients in online products and services. Despite their centrality in the competition between online companies who offer prediction-based products,…

Computer Science and Game Theory · Computer Science 2019-05-08 Omer Ben-Porat , Moshe Tennenholtz

Zero-sum games have long guided artificial intelligence research, since they possess both a rich strategy space of best-responses and a clear evaluation metric. What's more, competition is a vital mechanism in many real-world multi-agent…

Computer Science and Game Theory · Computer Science 2020-03-03 Edward Hughes , Thomas W. Anthony , Tom Eccles , Joel Z. Leibo , David Balduzzi , Yoram Bachrach

We initiate the study of how to perturb the reward in a zero-sum Markov game with two players to induce a desirable Nash equilibrium, namely arbitrating. Such a problem admits a bi-level optimization formulation. The lower level requires…

Multiagent Systems · Computer Science 2023-02-21 Jing Wang , Meichen Song , Feng Gao , Boyi Liu , Zhaoran Wang , Yi Wu

We propose a toy model for a stochastic description of the competition between two athletes of unequal strength, whose average strength difference is represented by a parameter $d$. The athletes interact through the choice of their…

Physics and Society · Physics 2019-05-24 Cecile Appert-Rolland , Hendrik-Jan Hilhorst , Amandine Aftalion