English
Related papers

Related papers: Fast value iteration: A uniform approach to effici…

200 papers

Value iteration is a fundamental algorithm for solving Markov Decision Processes (MDPs). It computes the maximal $n$-step payoff by iterating $n$ times a recurrence equation which is naturally associated to the MDP. At the same time, value…

Formal Languages and Automata Theory · Computer Science 2019-04-30 Nikhil Balaji , Stefan Kiefer , Petr Novotný , Guillermo A. Pérez , Mahsa Shirmohammadi

We study the problem of repeated play in a zero-sum game in which the payoff matrix may change, in a possibly adversarial fashion, on each round; we call these Online Matrix Games. Finding the Nash Equilibrium (NE) of a two player zero-sum…

Machine Learning · Computer Science 2020-04-06 Adrian Rivera Cardoso , Jacob Abernethy , He Wang , Huan Xu

Valuation problems, such as feature interpretation, data valuation and model valuation for ensembles, become increasingly more important in many machine learning applications. Such problems are commonly solved by well-known game-theoretic…

Machine Learning · Computer Science 2022-05-13 Yatao Bian , Yu Rong , Tingyang Xu , Jiaxiang Wu , Andreas Krause , Junzhou Huang

We study nondeterministic strategies in parity games with the aim of computing a most permissive winning strategy. Following earlier work, we measure permissiveness in terms of the average number/weight of transitions blocked by the…

Logic in Computer Science · Computer Science 2013-01-14 Patricia Bouyer , Nicolas Markey , Jörg Olschewski , Michael Ummels

Institutions and investors face the constant challenge of making accurate decisions and predictions regarding how best they should distribute their endowments. The problem of achieving an optimal outcome at minimal cost has been extensively…

Multiagent Systems · Computer Science 2021-02-09 Theodor Cimpeanu , Cedric Perret , The Anh Han

We provide a unifying view of a large family of previous imitation learning algorithms through the lens of moment matching. At its core, our classification scheme is based on whether the learner attempts to match (1) reward or (2)…

Machine Learning · Computer Science 2021-06-14 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

We consider the problem of selecting $k$ seed nodes in a network to maximize the minimum probability of activation under an independent cascade beginning at these seeds. The motivation is to promote fairness by ensuring that even the least…

Social and Information Networks · Computer Science 2025-02-20 Dennis Robert Windham , Caroline J. Wendt , Alex Crane , Madelyn J Warr , Freda Shi , Sorelle A. Friedler , Blair D. Sullivan , Aaron Clauset

Parity games are two player games with omega-winning conditions, played on finite graphs. Such games play an important role in verification, satisfiability and synthesis. It is therefore important to identify algorithms that can efficiently…

Logic in Computer Science · Computer Science 2018-09-11 Lisette Sanchez , Wieger Wesselink , Tim A. C. Willemse

The recent breakthrough paper by Calude et al. has given the first algorithm for solving parity games in quasi-polynomial time, where previously the best algorithms were mildly subexponential. We devise an alternative quasi-polynomial time…

Data Structures and Algorithms · Computer Science 2020-01-15 Marcin Jurdzinski , Ranko Lazic

We present a framework for computing approximate mixed-strategy Nash equilibria of continuous-action games. It is a modification of the traditional double oracle algorithm, extended to multiple players and continuous action spaces. Unlike…

Computer Science and Game Theory · Computer Science 2024-06-14 Carlos Martin , Tuomas Sandholm

This paper considers online optimization of a renewal-reward system. A controller performs a sequence of tasks back-to-back. Each task has a random vector of parameters, called the task type vector, that affects the task processing options…

Optimization and Control · Mathematics 2021-06-01 Michael J. Neely

In this paper, we reconsider two new iterative methods for solving absolute value equations (AVE), which is proposed by Ali and Pan (Jpn. J. Ind. Appl. Math. 40: 303--314, 2023). Convergence results of the two iterative schemes and new…

Numerical Analysis · Mathematics 2024-12-17 Jiayu Liu , Tingting Luo , Cairong Chen

It is known that the model checking problem for the modal mu-calculus reduces to the problem of solving a parity game and vice-versa. The latter is realised by the Walukiewicz formulas which are satisfied by a node in a parity game iff…

Logic in Computer Science · Computer Science 2014-08-27 Florian Bruse , Michael Falk , Martin Lange

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

We study parity games in which one of the two players controls only a small number $k$ of nodes and the other player controls the $n-k$ other nodes of the game. Our main result is a fixed-parameter algorithm that solves bipartite parity…

Computational Complexity · Computer Science 2015-12-12 Matthias Mnich , Heiko Röglin , Clemens Rösner

The strategy improvement algorithm for mean payoff games and parity games is a local improvement algorithm, just like the simplex algorithm for linear programs. Their similarity has turned out very useful: many lower bounds on running time…

Computer Science and Game Theory · Computer Science 2025-09-22 Matthew Maat

We define a class of zero-sum games with combinatorial structure, where the best response problem of one player is to maximize a submodular function. For example, this class includes security games played on networks, as well as the problem…

Computer Science and Game Theory · Computer Science 2017-12-04 Bryan Wilder

In prediction-based decision-making systems, different perspectives can be at odds: The short-term business goals of the decision makers are often in conflict with the decision subjects' wish to be treated fairly. Balancing these two…

Computers and Society · Computer Science 2023-05-03 Corinna Hertweck , Joachim Baumann , Michele Loi , Eleonora Viganò , Christoph Heitz

Two standard algorithms for approximately solving two-player zero-sum concurrent reachability games are value iteration and strategy iteration. We prove upper and lower bounds of 2^(m^(Theta(N))) on the worst case number of iterations…

Computer Science and Game Theory · Computer Science 2012-03-02 Kristoffer Arnsfelt Hansen , Rasmus Ibsen-Jensen , Peter Bro Miltersen

The latest developments in AI focus on agentic systems where artificial and human agents cooperate to realize global goals. An example is collaborative learning, which aims to train a global model based on data from individual agents. A…

Computer Science and Game Theory · Computer Science 2025-08-20 Björn Filter , Ralf Möller , Özgür Lütfü Özçep