English
Related papers

Related papers: Fast value iteration: A uniform approach to effici…

200 papers

We provide a unifying, black-box tool for establishing existence of approximate equilibria in weighted congestion games and, at the same time, bounding their Price of Stability. Our framework can handle resources with general…

Computer Science and Game Theory · Computer Science 2022-03-31 Yiannis Giannakopoulos , Diogo Poças

We generalise the hyperplane separation technique (Chatterjee and Velner, 2013) from multi-dimensional mean-payoff to energy games, and achieve an algorithm for solving the latter whose running time is exponential only in the dimension, but…

Computer Science and Game Theory · Computer Science 2021-09-07 Marcin Jurdziński , Ranko Lazić , Sylvain Schmitz

We define memory-efficient certificates for $\mu$-calculus model checking problems based on the well-known correspondence of the $\mu$-calculus model checking with winning certain parity games. Winning strategies can independently checked,…

Logic in Computer Science · Computer Science 2014-01-09 Martin Hofmann , Harald Ruess

Value iteration is a popular algorithm for finding near optimal policies for POMDPs. It is inefficient due to the need to account for the entire belief space, which necessitates the solution of large numbers of linear programs. In this…

Artificial Intelligence · Computer Science 2011-07-04 N. L. Zhang , W. Zhang

Designing distributed algorithms for multi-agent problems is vital for many emerging application domains, and game-theoretic approaches are emerging as a useful paradigm to design such algorithms. However, much of the emphasis of the…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Rohit Konda , Rahul Chandan , David Grimsman , Jason R. Marden

Many real-world problems rely on finding eigenvalues and eigenvectors of a matrix. The power iteration algorithm is a simple method for determining the largest eigenvalue and associated eigenvector of a general matrix. This algorithm relies…

Numerical Analysis · Mathematics 2021-09-23 Congzhou M Sha , Nikolay V Dokholyan

This study strengthens the links between Mean Payoff Games (\MPG{s}) and Energy Games (EG{s}). Firstly, we offer a faster $O(|V|^2|E|W)$ pseudo-polynomial time and $\Theta(|V|+|E|)$ space deterministic algorithm for solving the Value…

Data Structures and Algorithms · Computer Science 2016-09-07 Carlo Comin , Romeo Rizzi

We study the ranking of individuals, teams, or objects, based on pairwise comparisons between them, using the Bradley-Terry model. Estimates of rankings within this model are commonly made using a simple iterative algorithm first introduced…

Machine Learning · Statistics 2023-08-16 M. E. J. Newman

We consider game-theoretically secure distributed protocols for coalition games that approximate the Shapley value with small multiplicative error. Since all known existing approximation algorithms for the Shapley value are randomized, it…

Computer Science and Game Theory · Computer Science 2024-12-30 T-H. Hubert Chan , Qipeng Kuang , Quan Xue

When are two algorithms the same? How can we be sure a recently proposed algorithm is novel, and not a minor twist on an existing method? In this paper, we present a framework for reasoning about equivalence between a broad class of…

Optimization and Control · Mathematics 2025-01-13 Shipu Zhao , Laurent Lessard , Madeleine Udell

We consider finite-state Markov decision processes with the combined Energy-MeanPayoff objective. The controller tries to avoid running out of energy while simultaneously attaining a strictly positive mean payoff in a second dimension. We…

Computer Science and Game Theory · Computer Science 2025-10-13 Mohan Dantam , Richard Mayr

Value Iteration is a widely used algorithm for solving Markov Decision Processes (MDPs). While previous studies have extensively analyzed its convergence properties, they primarily focus on convergence with respect to the infinity norm. In…

Machine Learning · Computer Science 2025-02-06 Arsenii Mustafin , Sebastien Colla , Alex Olshevsky , Ioannis Ch. Paschalidis

We present efficient algorithms for computing optimal or approximately optimal strategies in a zero-sum game for which Player I has n pure strategies and Player II has an arbitrary number of pure strategies. We assume that for any given…

Optimization and Control · Mathematics 2018-06-21 Lisa Hellerstein , Thomas Lidbetter , Daniel Pirutinsky

A recent method for solving zero-sum partially observable stochastic games (zs-POSGs) embeds the original game into a new one called the occupancy Markov game. This reformulation allows applying Bellman's principle of optimality to solve…

Computer Science and Game Theory · Computer Science 2024-06-04 Erwan Escudie , Matthia Sabatelli , Jilles Dibangoye

Today's multiagent systems have grown too complex to rely on centralized controllers, prompting increasing interest in the design of distributed algorithms. In this respect, game theory has emerged as a valuable tool to complement more…

Systems and Control · Computer Science 2020-02-19 Rahul Chandan , Dario Paccagnan , Jason R. Marden

We study online optimization methods for zero-sum games, a fundamental problem in adversarial learning in machine learning, economics, and many other domains. Traditional methods approximate Nash equilibria (NE) using either regret-based…

Computer Science and Game Theory · Computer Science 2025-07-16 Taemin Kim , James P. Bailey

Distributed network optimization has been studied for well over a decade. However, we still do not have a good idea of how to design schemes that can simultaneously provide good performance across the dimensions of utility optimality,…

Networking and Internet Architecture · Computer Science 2017-07-19 Sinong Wang , Ness Shroff

The window mechanism was introduced by Chatterjee et al. to reinforce mean-payoff and total-payoff objectives with time bounds in two-player turn-based games on graphs. It has since proved useful in a variety of settings, including parity…

Computer Science and Game Theory · Computer Science 2021-08-12 James C. A. Main , Mickael Randour , Jeremy Sproston

Some well-known solutions for cooperative games with transferable utility (TU-games), such as the Banzhaf value, the Myerson value, and the Aumann-Dreze value, fail to satisfy efficiency. Despite their desirable normative properties, this…

Theoretical Economics · Economics 2026-01-01 Yukihiko Funaki , Yukio Koriyama , Satoshi Nakada

Value iteration is a commonly used and empirically competitive method in solving many Markov decision process problems. However, it is known that value iteration has only pseudo-polynomial complexity in general. We establish a somewhat…

Artificial Intelligence · Computer Science 2013-01-07 Omid Madani
‹ Prev 1 3 4 5 6 7 10 Next ›