中文
相关论文

相关论文: Decentralized model-free reinforcement learning in…

200 篇论文

Motivated by the scarcity of accurate payoff feedback in practical applications of game theory, we examine a class of learning dynamics where players adjust their choices based on past payoff observations that are subject to noise and…

最优化与控制 · 数学 2016-06-03 Mario Bravo , Panayotis Mertikopoulos

In this work, we study stochastic non-cooperative games, where only noisy black-box function evaluations are available to estimate the cost function for each player. Since each player's cost function depends on both its own decision…

计算机科学与博弈论 · 计算机科学 2025-11-18 Haidong Li , Anzhi Sheng , Yijie Peng , Long Wang

Independent learners are agents that employ single-agent algorithms in multi-agent systems, intentionally ignoring the effect of other strategic agents. This paper studies mean-field games from a decentralized learning perspective, with two…

计算机科学与博弈论 · 计算机科学 2025-02-04 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

The literature on game-theoretic equilibrium finding predominantly focuses on single games or their repeated play. Nevertheless, numerous real-world scenarios feature playing a game sampled from a distribution of similar, but not identical…

计算机科学与博弈论 · 计算机科学 2024-02-21 David Sychrovský , Michal Šustr , Elnaz Davoodi , Michael Bowling , Marc Lanctot , Martin Schmid

We consider a collaborative online learning paradigm, wherein a group of agents connected through a social network are engaged in playing a stochastic multi-armed bandit game. Each time an agent takes an action, the corresponding reward is…

机器学习 · 计算机科学 2016-07-12 Ravi Kumar Kolla , Krishna Jagannathan , Aditya Gopalan

Game theory is a very profound study on distributed decision-making behavior and has been extensively developed by many scholars. However, many existing works rely on certain strict assumptions such as knowing the opponent's private…

计算机科学与博弈论 · 计算机科学 2020-04-21 Kuo Chun Tsai , Zhu Han

In this paper, we study the distributed generalized Nash equilibrium seeking problem of non-cooperative games in dynamic environments. Each player in the game aims to minimize its own time-varying cost function subject to a local action…

最优化与控制 · 数学 2020-04-02 Kaihong Lu , Guangqi Li , Long Wang

This paper considers no-regret learning for repeated continuous-kernel games with lossy bandit feedback. Since it is difficult to give the explicit model of the utility functions in dynamic environments, the players' action can only be…

机器学习 · 计算机科学 2022-05-17 Wenting Liu , Jinlong Lei , Peng Yi , Yiguang Hong

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

计算机科学与博弈论 · 计算机科学 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

We study a stochastic differential game with $N$ competitive players in a linear-quadratic framework with ergodic cost, where $d$-dimensional diffusion processes govern the state dynamics with an unknown common drift (matrix). Assuming a…

最优化与控制 · 数学 2026-01-30 Asaf Cohen , Ruolan He , Yuqiong Wang

Classic no-regret multi-armed bandit algorithms, including the Upper Confidence Bound (UCB), Hedge, and EXP3, are inherently unfair by design. Their unfairness stems from their objective of playing the most rewarding arm as frequently as…

机器学习 · 计算机科学 2024-05-14 Abhishek Sinha

In two-player zero-sum games, the learning dynamic based on optimistic Hedge achieves one of the best-known regret upper bounds among strongly-uncoupled learning dynamics. With an appropriately chosen learning rate, the social and…

机器学习 · 计算机科学 2025-10-14 Taira Tsuchiya

We consider the problem of online multi-agent Nash social welfare (NSW) maximization. While previous works of Hossain et al. [2021], Jones et al. [2023] study similar problems in stochastic multi-agent multi-armed bandits and show that…

机器学习 · 计算机科学 2024-06-03 Mengxiao Zhang , Ramiro Deo-Campo Vuong , Haipeng Luo

Online reinforcement learning in infinite-horizon Markov decision processes (MDPs) remains less theoretically and algorithmically developed than its episodic counterpart, with many algorithms suffering from high ``burn-in'' costs and…

机器学习 · 计算机科学 2026-03-26 Guy Zamir , Matthew Zurek , Yudong Chen

This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular,…

机器学习 · 计算机科学 2022-10-11 Taira Tsuchiya , Shinji Ito , Junya Honda

We formulate computation offloading as a decentralized decision-making problem with autonomous agents. We design an interaction mechanism that incentivizes agents to align private and system goals by balancing between competition and…

多智能体系统 · 计算机科学 2022-06-22 Jing Tan , Ramin Khalili , Holger Karl , Artur Hecker

We consider the problem of learning in adversarial Markov decision processes [MDPs] with an oblivious adversary in a full-information setting. The agent interacts with an environment during $T$ episodes, each of which consists of $H$…

机器学习 · 计算机科学 2025-03-06 Daniil Tiapkin , Evgenii Chzhen , Gilles Stoltz

Self-play methods based on regret minimization have become the state of the art for computing Nash equilibria in large two-players zero-sum extensive-form games. These methods fundamentally rely on the hierarchical structure of the players'…

计算机科学与博弈论 · 计算机科学 2019-10-29 Gabriele Farina , Chun Kai Ling , Fei Fang , Tuomas Sandholm

We study the problem of guaranteeing low regret in repeated games against an opponent with unknown membership in one of several classes. We add the constraint that our algorithm is non-exploitable, in that the opponent lacks an incentive to…

计算机科学与博弈论 · 计算机科学 2022-07-05 Anthony DiGiovanni , Ambuj Tewari

We propose an epoch-based reinforcement learning algorithm for infinite-horizon average-cost Markov decision processes (MDPs) that leverages a partial order over a policy class. In this structure, $\pi' \leq \pi$ if data collected under…

机器学习 · 统计学 2025-08-07 Zhongjun Zhang , Shipra Agrawal , Ilan Lobel , Sean R. Sinclair , Christina Lee Yu