English
Related papers

Related papers: Recursive Markov Process for Iterated Games with M…

200 papers

Pavlov, a well-known strategy in game theory, has been shown to have some advantages in the Iterated Prisoner's Dilemma (IPD) game. However, this strategy can be exploited by inveterate defectors. We modify this strategy to mitigate the…

Computer Science and Game Theory · Computer Science 2011-02-21 Martin Dyer , Velumailum Mohanaraj

We explore some strategies which tend to perform well in the IPD. We start off by showing the significance of Tit-For-Tat strategies in evolutionary game theory. This is followed by a theoretical derivation of zero-determinant strategies,…

Computer Science and Game Theory · Computer Science 2021-11-30 Anagh Malik

We study variants of a stochastic game inspired by backgammon where players may propose to double the stake, with the game state dictated by a one-dimensional random walk. Our variants allow for different numbers of proposals and different…

Optimization and Control · Mathematics 2024-10-28 Haoru Ju , Daniel Leifer , Steven J. Miller , Sooraj A. Padmanabhan , Chenyang Sun , Luke Tichi , Benjamin Tocher , Kiley Wallace

Two-player (antagonistic) games on (possibly stochastic) graphs are a prevalent model in theoretical computer science, notably as a framework for reactive synthesis. Optimal strategies may require randomisation when dealing with inherently…

Computer Science and Game Theory · Computer Science 2024-11-25 James C. A. Main , Mickael Randour

Graph games are fundamental in strategic reasoning of multi-agent systems and their environments. We study a new family of graph games which combine stochastic environmental uncertainties and auction-based interactions among the agents,…

Computer Science and Game Theory · Computer Science 2024-12-30 Guy Avni , Martin Kurečka , Kaushik Mallik , Petr Novotný , Suman Sadhukhan

We consider a scenario where N users try to access a common base station. Associated with each user is its channel state and a finite queue which varies with time. Each user chooses his power and the admission control variable in a dynamic…

Systems and Control · Computer Science 2012-10-31 Prashant Narayanan , Vinod Sharma

Matrix games like Prisoner's Dilemma have guided research on social dilemmas for decades. However, they necessarily treat the choice to cooperate or defect as an atomic action. In real-world social dilemmas these choices are temporally…

Multiagent Systems · Computer Science 2017-02-13 Joel Z. Leibo , Vinicius Zambaldi , Marc Lanctot , Janusz Marecki , Thore Graepel

We study learning in a dynamically evolving environment modeled as a Markov game between a learner and a strategic opponent that can adapt to the learner's strategies. While most existing works in Markov games focus on external regret as…

Machine Learning · Computer Science 2024-12-11 Thanh Nguyen-Tang , Raman Arora

Using an approximation by a set-valued dynamical system, this paper studies a class of non Markovian and non homogeneous stochastic processes on a finite state space. It provides an unified approach to simulated annealing type processes. It…

Probability · Mathematics 2008-12-18 Michel Benaim , Olivier Raimond

We study a game where one player selects a random function, and the other has to guess that function, and show that with high probability the second player can correctly guess most of the random function. We apply this analysis to…

Optimization and Control · Mathematics 2023-11-28 Catherine Rainer , Eilon Solan

In games with a large number of players where players may have overlapping objectives, the analysis of stable outcomes typically depends on player types. A special case is when a large part of the player population consists of imitation…

Computer Science and Game Theory · Computer Science 2010-06-18 Soumya Paul , R. Ramanujam

A Markov decision problem is called reversible if the stationary controlled Markov chain is reversible under every stationary Markovian strategy. A natural application in which such problems arise is in the control of Metropolis-Hastings…

Probability · Mathematics 2022-07-13 Venkat Anantharam

Evolutionary game theory assumes that players replicate a highly scored player's strategy through genetic inheritance. However, when learning occurs culturally, it is often difficult to recognize someone's strategy just by observing the…

Populations and Evolution · Quantitative Biology 2021-07-01 Minjae Kim , Jung-Kyoo Choi , Seung Ki Baek

An interesting iterative procedure is proposed to solve a two-player zero-sum Markov games. Under suitable assumption, the boundedness of the proposed iterates is obtained theoretically. Using results from stochastic approximation, the…

Machine Learning · Computer Science 2025-09-23 Shreyas S R , Antony Vijesh

This paper investigates backdoor attack planning in stochastic control systems modeled as Markov Decision Processes (MDPs). A backdoor attack involves an adversary deploying a policy that performs well in the original MDP to pass testing,…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Xinyi Wei , Shuo Han , Ahmed H. Hemida , Charles A. Kamhoua , Jie Fu

The paper is concerned with a zero-sum continuous-time stochastic differential game with a dynamics controlled by a Markov process and a terminal payoff. The value function of the original game is estimated using the value function of a…

Optimization and Control · Mathematics 2016-02-16 Yurii Averboukh

Game theory is the standard tool used to model strategic interactions in evolutionary biology and social science. Traditional game theory studies the equilibria of simple games. But is traditional game theory applicable if the game is…

Chaotic Dynamics · Physics 2011-09-22 Tobias Galla , J. Doyne Farmer

We consider a nonzero-sum N-player Markov game on an abstract measurable state space with compact metric action spaces. The payoff functions are bounded Carath\'eodory functions and the transitions of the system are assumed to have a…

Optimization and Control · Mathematics 2023-05-09 François Dufour , Tomás Prieto-Rumeau

This paper examines the integration of computational complexity into game theoretic models. The example focused on is the Prisoner's Dilemma, repeated for a finite length of time. We show that a minimal bound on the players' computational…

Computer Science and Game Theory · Computer Science 2007-05-23 Yishay Mor , Jeffrey S. Rosenschein

Individual cooperative strategy influences the surrounding dynamic population, which in turn affects cooperative strategy. To better model this phenomenon, we develop a Markov decision chain based game transitions model and examine the…

Physics and Society · Physics 2025-12-30 Chaoyang Luo , Yuji Zhang , Minyu Feng , Attila Szolnoki