中文
相关论文

相关论文: No-regret Learning in Cournot Games

200 篇论文

We develop an algorithmic framework for solving convex optimization problems using no-regret game dynamics. By converting the problem of minimizing a convex function into an auxiliary problem of solving a min-max game in a sequential…

机器学习 · 计算机科学 2023-02-21 Jun-Kun Wang , Jacob Abernethy , Kfir Y. Levy

Motivated by the scarcity of accurate payoff feedback in practical applications of game theory, we examine a class of learning dynamics where players adjust their choices based on past payoff observations that are subject to noise and…

最优化与控制 · 数学 2016-06-03 Mario Bravo , Panayotis Mertikopoulos

Recent price-of-anarchy analyses of games of complete information suggest that coarse correlated equilibria, which characterize outcomes resulting from no-regret learning dynamics, have near-optimal welfare. This work provides two main…

计算机科学与博弈论 · 计算机科学 2015-11-23 Jason Hartline , Vasilis Syrgkanis , Eva Tardos

We consider an online stochastic game with risk-averse agents whose goal is to learn optimal decisions that minimize the risk of incurring significantly high costs. Specifically, we use the Conditional Value at Risk (CVaR) as a risk measure…

机器学习 · 计算机科学 2022-06-17 Zifan Wang , Yi Shen , Michael M. Zavlanos

The notion of \emph{policy regret} in online learning is a well defined? performance measure for the common scenario of adaptive adversaries, which more traditional quantities such as external regret do not take into account. We revisit the…

机器学习 · 计算机科学 2020-03-24 Raman Arora , Michael Dinitz , Teodor V. Marinov , Mehryar Mohri

Real world applications such as economics and policy making often involve solving multi-agent games with two unique features: (1) The agents are inherently asymmetric and partitioned into leaders and followers; (2) The agents have different…

机器学习 · 计算机科学 2021-11-04 Yu Bai , Chi Jin , Huan Wang , Caiming Xiong

We study the problem of learning in zero-sum matrix games with repeated play and bandit feedback. Specifically, we focus on developing uncoupled algorithms that guarantee, without communication between players, the convergence of the…

机器学习 · 计算机科学 2026-04-20 Côme Fiegel , Pierre Ménard , Tadashi Kozuno , Michal Valko , Vianney Perchet

Regret minimization methods are a powerful tool for learning approximate Nash equilibrium (NE) in two-player zero-sum imperfect information extensive-form games (IIEGs). We consider the problem in the interactive bandit-feedback setting…

机器学习 · 计算机科学 2023-08-21 Linjian Meng , Yang Gao

Regret minimization is a powerful method for finding Nash equilibria in Normal-Form Games (NFGs) and Extensive-Form Games (EFGs), but it typically guarantees convergence only for the average strategy. However, computing the average strategy…

计算机科学与博弈论 · 计算机科学 2025-09-18 Hang Ren , Yulin Wu , Shuhan Qi , Jiajia Zhang , Xiaozhen Sun , Tianzi Ma , Xuan Wang

We study online learning in two-player uninformed Markov games, where the opponent's actions and policies are unobserved. In this setting, Tian et al. (2021) show that achieving no-external-regret is impossible without incurring an…

机器学习 · 计算机科学 2026-02-10 Junyan Liu , Haipeng Luo , Zihan Zhang , Lillian J. Ratliff

Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, where only the loss of the selected action pair is observed, Fiegel et al. (2025) show a…

机器学习 · 计算机科学 2026-05-12 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

Considering a class of gradient-based multi-agent learning algorithms in non-cooperative settings, we provide local convergence guarantees to a neighborhood of a stable local Nash equilibrium. In particular, we consider continuous games…

最优化与控制 · 数学 2024-09-23 Benjamin Chasnov , Lillian J. Ratliff , Eric Mazumdar , Samuel A. Burden

We show that Optimistic Hedge -- a common variant of multiplicative-weights-updates with recency bias -- attains ${\rm poly}(\log T)$ regret in multi-player general-sum games. In particular, when every player of the game uses Optimistic…

机器学习 · 计算机科学 2023-01-26 Constantinos Daskalakis , Maxwell Fishelson , Noah Golowich

We use co-evolutionary genetic algorithms to model the players' learning process in several Cournot models, and evaluate them in terms of their convergence to the Nash Equilibrium. The "social-learning" versions of the two co-evolutionary…

计算机科学与博弈论 · 计算机科学 2010-05-13 Mattheos K. Protopapas , Elias B. Kosmatopoulos , Francesco Battaglia

Self-play methods based on regret minimization have become the state of the art for computing Nash equilibria in large two-players zero-sum extensive-form games. These methods fundamentally rely on the hierarchical structure of the players'…

计算机科学与博弈论 · 计算机科学 2019-10-29 Gabriele Farina , Chun Kai Ling , Fei Fang , Tuomas Sandholm

This paper investigates equilibrium computation and the price of anarchy for Bayesian games, which are the fundamental models of games with incomplete information. In normal-form games with complete information, it is known that efficiently…

计算机科学与博弈论 · 计算机科学 2025-07-01 Kaito Fujii

We analyze the performance of the best-response dynamic across all normal-form games using a random games approach. The playing sequence -- the order in which players update their actions -- is essentially irrelevant in determining whether…

理论经济学 · 经济学 2022-11-18 Torsten Heinrich , Yoojin Jang , Luca Mungo , Marco Pangallo , Alex Scott , Bassel Tarbush , Samuel Wiese

Counterfactual regret minimization (CFR) is an effective algorithm for solving extensive games with imperfect information (IIEGs). However, CFR is only allowed to be applied in known environments, where the transition function of the chance…

计算机科学与博弈论 · 计算机科学 2024-10-30 Chen Qiu , Xuan Wang , Tianzi Ma , Yaojun Wen , Jiajia Zhang

A recent line of work has established uncoupled learning dynamics such that, when employed by all players in a game, each player's \emph{regret} after $T$ repetitions grows polylogarithmically in $T$, an exponential improvement over the…

计算机科学与博弈论 · 计算机科学 2022-10-18 Gabriele Farina , Ioannis Anagnostides , Haipeng Luo , Chung-Wei Lee , Christian Kroer , Tuomas Sandholm

We study risk-sensitive multi-agent reinforcement learning under general-sum Markov games, where agents optimize the entropic risk measure of rewards with possibly diverse risk preferences. We show that using the regret naively adapted from…

机器学习 · 计算机科学 2024-05-07 Yingjie Fei , Ruitu Xu