English
Related papers

Related papers: A coding theoretic study of homogeneous Markovian …

200 papers

Prediction is a well-studied machine learning task, and prediction algorithms are core ingredients in online products and services. Despite their centrality in the competition between online companies who offer prediction-based products,…

Computer Science and Game Theory · Computer Science 2019-05-09 Omer Ben-Porat , Moshe Tennenholtz

In a zero-sum stochastic game with signals, at each stage, two adversary players take decisions and receive a stage payoff determined by these decisions and a variable called state. The state follows a Markov chain, that is controlled by…

Optimization and Control · Mathematics 2021-12-02 Bruno Ziliotto

The paper is concerned with a zero-sum continuous-time stochastic differential game with a dynamics controlled by a Markov process and a terminal payoff. The value function of the original game is estimated using the value function of a…

Optimization and Control · Mathematics 2016-02-16 Yurii Averboukh

Cooperative Parrondo's games on a regular two dimensional lattice are analyzed based on the computer simulations and on the discrete-time Markov chain model with exact transition probabilities. The paradox appears in the vicinity of the…

Statistical Mechanics · Physics 2009-11-11 Zoran Mihailovic , Milan Rajkovic

A basic question for zero-sum repeated games consists in determining whether the mean payoff per time unit is independent of the initial state. In the special case of "zero-player" games, i.e., of Markov chains equipped with additive…

Optimization and Control · Mathematics 2015-10-20 Marianne Akian , Stéphane Gaubert , Antoine Hochart

Continuous-time empirical dynamic discrete choice games offer notable computational advantages over discrete-time models. This paper addresses remaining computational and econometric challenges to further improve both model solution and…

Econometrics · Economics 2025-11-11 Jason R. Blevins

In stochastic dynamic environments, team Markov games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually…

Optimization and Control · Mathematics 2022-05-03 Feng Huang , Ming Cao , Long Wang

This article presents a new game semantics for Martin-L\"of type theory (MLTT), in which each game is equipped with selected isomorphism strategies that represent (computational) proofs for (intensional) equality between strategies on the…

Logic in Computer Science · Computer Science 2017-05-04 Norihiro Yamada

By adapting techniques of Arhangel'skii, Barman, and Dow, we may equate the existence of perfect-information, Markov, and tactical strategies between two interesting selection games. These results shed some light on Gruenhage's question…

General Topology · Mathematics 2016-10-18 Steven Clontz

This paper deals with N-person nonzero-sum discrete-time Markov games under a probability criterion, in which the transition probabilities and reward functions are allowed to vary with time. Differing from the existing works on the expected…

Probability · Mathematics 2025-05-16 Xin Guo , Xin Wen

We show that the Brier game of prediction is mixable and find the optimal learning rate and substitution function for it. The resulting prediction algorithm is applied to predict results of football and tennis matches. The theoretical…

Machine Learning · Computer Science 2009-11-02 Vladimir Vovk , Fedor Zhdanov

This paper provides necessary and sufficient conditions for a pair of randomised stopping times to form a saddle point of a zero-sum Dynkin game with partial and/or asymmetric information across players. The framework is non-Markovian and…

Probability · Mathematics 2025-10-20 Tiziano De Angelis , Jan Palczewski , Jacob Smith

We apply the method of defensive forecasting, based on the use of game-theoretic supermartingales, to prediction with expert advice. In the traditional setting of a countable number of experts and a finite number of outcomes, the Defensive…

Machine Learning · Computer Science 2010-03-12 Alexey Chernov , Yuri Kalnishkan , Fedor Zhdanov , Vladimir Vovk

Strong typicality and the Markov lemma have been used in the proofs of several multiterminal source coding theorems. Since these two tools can be applied to finite alphabets only, the results proved by them are subject to the same…

Information Theory · Computer Science 2010-06-03 Siu-Wai Ho

Game theory's prescriptive power typically relies on full rationality and/or self-play interactions. In contrast, this work sets aside these fundamental premises and focuses instead on heterogeneous autonomous interactions between two or…

Computer Science and Game Theory · Computer Science 2012-03-19 Enrique Munoz de Cote , Archie C. Chapman , Adam M. Sykulski , Nicholas R. Jennings

Playing repeated matrix games (RMG) while maximizing the cumulative returns is a basic method to evaluate multi-agent learning (MAL) algorithms. Previous work has shown that $UCB$, $M3$, $S$ or $Exp3$ algorithms have good behaviours on…

Machine Learning · Computer Science 2018-11-02 Bruno Bouzy , Marc Métivier , Damien Pellier

In many multi-agent settings, participants can form teams to achieve collective outcomes that may far surpass their individual capabilities. Measuring the relative contributions of agents and allocating them shares of the reward that…

Machine Learning · Computer Science 2022-08-19 Daphne Cornelisse , Thomas Rood , Mateusz Malinowski , Yoram Bachrach , Tal Kachman

We consider the problem of collaborative inference in a sensor network with heterogeneous and statistically dependent sensor observations. Each sensor aims to maximize its inference performance by forming a coalition with other sensors and…

Information Theory · Computer Science 2016-04-20 Hao He , Pramod K. Varshney

This paper introduces Logical Credal Networks, an expressive probabilistic logic that generalizes many prior models that combine logic and probability. Given imprecise information represented by probability bounds and conditional…

Artificial Intelligence · Computer Science 2021-09-28 Haifeng Qian , Radu Marinescu , Alexander Gray , Debarun Bhattacharjya , Francisco Barahona , Tian Gao , Ryan Riegel , Pravinda Sahu

This note proves a law of large numbers for predicting several steps ahead, which, in the case of uniformly bounded random variables, generalizes the standard law of large numbers for martingales; the standard law of large numbers…

Probability · Mathematics 2026-04-14 Vladimir Vovk