English
Related papers

Related papers: Algorithms and Conditional Lower Bounds for Planni…

200 papers

This article presents the complexity of reachability decision problems for parametric Markov decision processes (pMDPs), an extension to Markov decision processes (MDPs) where transitions probabilities are described by polynomials over a…

Logic in Computer Science · Computer Science 2020-09-29 Sebastian Junges , Joost-Pieter Katoen , Guillermo A. Pérez , Tobias Winkler

We consider the incomplete multi-graph matching problem, which is a generalization of the NP-hard quadratic assignment problem for matching multiple finite sets. Multi-graph matching plays a central role in computer vision, e.g., for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Max Kahl , Sebastian Stricker , Lisa Hutschenreiter , Florian Bernard , Bogdan Savchynskyy

Recent successes of game-theoretic formulations in ML have caused a resurgence of research interest in differentiable games. Overwhelmingly, that research focuses on methods and upper bounds on their speed of convergence. In this work, we…

Machine Learning · Computer Science 2020-09-16 Adam Ibrahim , Waïss Azizian , Gauthier Gidel , Ioannis Mitliagkas

In recent years, there has been a growing interest in games on graphs within the research community, fueled by their relevance in applications such as economics, politics, and epidemiology. This paper aims to comprehensively detail the…

Computer Science and Game Theory · Computer Science 2024-06-11 Christian Giannetti

We consider both finite-state game graphs and recursive game graphs (or pushdown game graphs), that can model the control flow of sequential programs with recursion, with multi-dimensional mean-payoff objectives. In pushdown games two types…

Computer Science and Game Theory · Computer Science 2013-08-09 Krishnendu Chatterjee , Yaron Velner

A dynamic graph algorithm is a data structure that answers queries about a property of the current graph while supporting graph modifications such as edge insertions and deletions. Prior work has shown strong conditional lower bounds for…

Data Structures and Algorithms · Computer Science 2023-01-30 Monika Henzinger , Ami Paz , A. R. Sricharan

We introduce the notion of quantum Markov decision process (qMDP) as a semantic model of nondeterministic and concurrent quantum programs. It is shown by examples that qMDPs can be used in analysis of quantum algorithms and protocols. We…

Quantum Physics · Physics 2014-07-10 Shenggang Ying , Mingsheng Ying

We consider two-player stochastic games played on a finite graph for infinitely many rounds. Stochastic games generalize both Markov decision processes (MDP) by adding an adversary player, and two-player deterministic games by adding…

Computer Science and Game Theory · Computer Science 2022-02-28 Laurent Doyen

We study and provide efficient algorithms for multi-objective model checking problems for Markov Decision Processes (MDPs). Given an MDP, M, and given multiple linear-time (\omega -regular or LTL) properties \varphi\_i, and probabilities…

Logic in Computer Science · Computer Science 2015-07-01 Kousha Etessami , Marta Kwiatkowska , Moshe Y. Vardi , Mihalis Yannakakis

We study the time-bounded reachability problem for continuous-time Markov decision processes (CTMDPs) and games (CTMGs). Existing techniques for this problem use discretisation techniques to break time into discrete intervals, and optimal…

Computer Science and Game Theory · Computer Science 2011-07-11 John Fearnley , Markus Rabe , Sven Schewe , Lijun Zhang

{\em Algorithms with predictions} incorporate machine learning predictions into algorithm design. A plethora of recent works incorporated predictions to improve on worst-case optimal bounds for online problems. In this paper, we initiate…

Data Structures and Algorithms · Computer Science 2023-09-12 Monika Henzinger , Barna Saha , Martin P. Seybold , Christopher Ye

When reasoning about the strategic capabilities of an agent, it is important to consider the nature of its adversaries. In the particular context of controller synthesis for quantitative specifications, the usual problem is to devise a…

Computer Science and Game Theory · Computer Science 2014-04-04 Véronique Bruyère , Emmanuel Filiot , Mickael Randour , Jean-François Raskin

We study deterministic games of infinite duration played on graphs and focus on the strategy complexity of quantitative objectives. Such games are known to admit optimal memoryless strategies over finite graphs, but require infinite-memory…

Computer Science and Game Theory · Computer Science 2024-06-26 Sougata Bose , Rasmus Ibsen-Jensen , David Purser , Patrick Totzke , Pierre Vandenhove

Markov decision processes (MDPs) and simple stochastic games (SSGs) provide a rich mathematical framework to study many important problems related to probabilistic systems. MDPs and SSGs with finite-horizon objectives, where the goal is to…

Computer Science and Game Theory · Computer Science 2012-09-18 Krishnendu Chatterjee , Rasmus Ibsen-Jensen

Markov Decision Processes (MDPs) are a popular class of models suitable for solving control decision problems in probabilistic reactive systems. We consider parametric MDPs (pMDPs) that include parameters in some of the transition…

Logic in Computer Science · Computer Science 2018-06-14 Sebastian Arming , Ezio Bartocci , Krishnendu Chatterjee , Joost-Pieter Katoen , Ana Sokolova

This paper presents a potential game-based method for non-myopic planning of mobile sensor networks in the context of target tracking. The planning objective is to select the sequence of sensing points over more than one future time steps…

Systems and Control · Computer Science 2019-11-15 Su-Jin Lee , Soon-Seo Park , Han-Lim Choi

We optimize finite horizon multi-agent reach-avoid Markov decision process (MDP) via \emph{local feedback policies}. The global feedback policy solution yields global optimality but its communication complexity, memory usage and computation…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Adam Casselman , Abraham P. Vinod , Sarah H. Q. Li

The Minimum Dominating Set (MDS) problem is one of the most fundamental and challenging problems in distributed computing. While it is well-known that minimum dominating sets cannot be approximated locally on general graphs, over the last…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-18 Saeed Akhoondian Amiri , Stefan Schmid , Sebastian Siebertz

We study the scheduling problem of makespan minimization while taking machine conflicts into account. Machine conflicts arise in various settings, e.g., shared resources for pre- and post-processing of tasks or spatial restrictions. In this…

Discrete Mathematics · Computer Science 2021-11-15 Moritz Buchem , Linda Kleist , Daniel Schmidt genannt Waldschmidt

Given a model and a specification, the fundamental model-checking problem asks for algorithmic verification of whether the model satisfies the specification. We consider graphs and Markov decision processes (MDPs), which are fundamental…

Data Structures and Algorithms · Computer Science 2018-04-16 Krishnendu Chatterjee , Monika Henzinger , Veronika Loitzenbauer , Simin Oraee , Viktor Toman