English
Related papers

Related papers: Is Thompson Sampling Susceptible to Algorithmic Co…

200 papers

This paper proposes a payoff perturbation technique for the Mirror Descent (MD) algorithm in games where the gradient of the payoff functions is monotone in the strategy profile space, potentially containing additive noise. The optimistic…

Computer Science and Game Theory · Computer Science 2024-06-25 Kenshi Abe , Kaito Ariu , Mitsuki Sakamoto , Atsushi Iwasaki

This paper studies the last-iterate convergence properties of the exponential weights algorithm with constant learning rates. We consider a repeated interaction in discrete time, where each player uses an exponential weights algorithm…

Artificial Intelligence · Computer Science 2024-07-10 Maurizio d'Andrea , Fabien Gensbittel , Jérôme Renault

Decision-making in multi-player games can be extremely challenging, particularly under uncertainty. In this work, we propose a new sample-based approximation to a class of stochastic, general-sum, pure Nash games, where each player has an…

Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus…

Logic in Computer Science · Computer Science 2019-07-09 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

The threat of algorithmic collusion, and whether it merits regulatory intervention, remains debated, as existing evaluations of its emergence often rely on long learning horizons, assumptions about counterparty rationality in adopting…

Multiagent Systems · Computer Science 2026-03-11 Yuhong Luo , Daniel Schoepflin , Xintong Wang

Real world applications such as economics and policy making often involve solving multi-agent games with two unique features: (1) The agents are inherently asymmetric and partitioned into leaders and followers; (2) The agents have different…

Machine Learning · Computer Science 2021-11-04 Yu Bai , Chi Jin , Huan Wang , Caiming Xiong

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

Machine Learning · Statistics 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky

One common assumption in game theory is that any player optimizes a utility function that takes into account only its own payoff. However, it has long been observed that in real life players may adopt an altruistic or even spiteful…

Computer Science and Game Theory · Computer Science 2025-11-25 Michail Fasoulakis , Leonidas Bakopoulos , Charilaos Akasiadis , Georgios Chalkiadakis

Thompson Sampling is a principled method for balancing exploration and exploitation, but its real-world adoption faces computational challenges in large-scale or non-conjugate settings. While ensemble-based approaches offer partial…

Machine Learning · Computer Science 2025-10-29 Yingru Li , Jiawei Xu , Baoxiang Wang , Zhi-Quan Luo

In this study, we present models where participants strategically select their risk levels and earn corresponding rewards, mirroring real-world competition across various sectors. Our analysis starts with a normal form game involving two…

Computational Finance · Quantitative Finance 2023-05-31 Louis Abraham

We study repeated games where players use an exponential learning scheme in order to adapt to an ever-changing environment. If the game's payoffs are subject to random perturbations, this scheme leads to a new stochastic version of the…

Probability · Mathematics 2010-10-22 Panayotis Mertikopoulos , Aris L. Moustakas

We study, to the best of our knowledge, the first Bayesian algorithm for unimodal Multi-Armed Bandit (MAB) problems with graph structure. In this setting, each arm corresponds to a node of a graph and each edge provides a relationship,…

Machine Learning · Computer Science 2016-11-23 Stefano Paladino , Francesco Trovò , Marcello Restelli , Nicola Gatti

The stag hunt (or assurance game) is a simple game that has been used as a prototype of a variety of social coordination problems (ranging from the social contract to the adoption of technical standards). Players have the option to either…

Computer Science and Game Theory · Computer Science 2018-05-24 Ioannis Avramopoulos

Congestion games are popular models often used to study the system-level inefficiencies caused by selfish agents, typically measured by the price of anarchy. One may expect that aligning the agents' preferences with the system-level…

Computer Science and Game Theory · Computer Science 2024-09-04 Bryce L Ferguson , Dario Paccagnan , Bary S R Pradelski , Jason R Marden

Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for…

Machine Learning · Statistics 2023-04-26 Xiuyuan Lu , Benjamin Van Roy

In multi-agent autonomous systems, deception is a fundamental concept which characterizes the exploitation of unbalanced information to mislead victims into choosing oblivious actions. This effectively alters the system's long term…

Systems and Control · Electrical Eng. & Systems 2025-08-27 Michael Tang , Miroslav Krstic , Jorge Poveda

In this work, we study potential games and Markov potential games under stochastic cost and bandit feedback. We propose a variant of the Frank-Wolfe algorithm with sufficient exploration and recursive gradient estimation, which provably…

Computer Science and Game Theory · Computer Science 2024-04-11 Jing Dong , Baoxiang Wang , Yaoliang Yu

We study a setting in which two players play a (possibly approximate) Nash equilibrium of a bimatrix game, while a learner observes only their actions and has no knowledge of the equilibrium or the underlying game. A natural question is…

Computer Science and Game Theory · Computer Science 2026-05-27 Annalisa Barbara , Riccardo Poiani , Martino Bernasconi , Andrea Celli

Pursuit-evasion is a multi-agent sequential decision problem wherein a group of agents known as pursuers coordinate their traversal of a spatial domain to locate an agent trying to evade them. Pursuit evasion problems arise in a number of…

Machine Learning · Computer Science 2018-11-13 Zhen Li , Nicholas J. Meyer , Eric B. Laber , Robert Brigantic

In this paper we consider an online recommendation setting, where a platform recommends a sequence of items to its users at every time period. The users respond by selecting one of the items recommended or abandon the platform due to…

Machine Learning · Computer Science 2019-04-16 Yunjuan Wang , Theja Tulabandhula