English
Related papers

Related papers: Policy Synthesis for Factored MDPs with Graph Temp…

200 papers

Computational agents support humans in many areas of life and are therefore found in heterogeneous contexts. This means they operate in rapidly changing environments and can be confronted with huge state and action spaces. In order to…

Artificial Intelligence · Computer Science 2023-08-31 Nicole Merkle , Ralf Mikut

We propose a distributed planning method with asynchronous execution for multi-agent pickup and delivery (MAPD) problems for environments with occasional delays in agents' activities and flexible endpoints. MAPD is a crucial problem…

Multiagent Systems · Computer Science 2023-02-21 Yuki Miyashita , Tomoki Yamauchi , Toshiharu Sugawara

Markov automata combine non-determinism, probabilistic branching, and exponentially distributed delays. This compositional variant of continuous-time Markov decision processes is used in reliability engineering, performance evaluation and…

Logic in Computer Science · Computer Science 2017-05-11 Tim Quatmann , Sebastian Junges , Joost-Pieter Katoen

This paper proposes an intelligent service optimization method based on a multi-agent collaborative evolution mechanism to address governance challenges in large-scale microservice architectures. These challenges include complex service…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Yilin Li , Song Han , Sibo Wang , Ming Wang , Renzi Meng

The assignment of tasks to multiple resources becomes an interesting game theoretic problem, when both the task owner and the resources are strategic. In the classical, nonstrategic setting, where the states of the tasks and resources are…

Computer Science and Game Theory · Computer Science 2012-02-20 Swaprava Nath , Onno Zoeter , Yadati Narahari , Christopher R. Dance

This article presents MAPS$^2$ : a distributed algorithm that allows multi-robot systems to deliver coupled tasks expressed as Signal Temporal Logic (STL) constraints. Classical control theoretical tools addressing STL constraints either…

Robotics · Computer Science 2025-12-17 Mayank Sewlia , Christos K. Verginis , Dimos V. Dimarogonas

Synthetic data has become increasingly important for training large language models, especially when real data is scarce, expensive, or privacy-sensitive. Many such generation tasks require coordinated multi-agent workflows, where…

This article investigates the consensus tracking problem of multi-agent systems under jointly connected topology through automated synthesis of Lyapunov functions. Based on the proposed distributed nonlinear control protocol, several…

Optimization and Control · Mathematics 2026-05-28 Shuyuan Zhang , Lei Wang , Qing-Guo Wang

We study the $(\varepsilon, \delta)$-PAC policy identification problem in finite-horizon episodic Markov Decision Processes. Existing approaches provide finite-time guarantees for approximate settings ($\varepsilon>0$) but suffer from high…

Machine Learning · Computer Science 2026-05-06 Cyrille Kone , Kevin Jamieson

Multi-agent systems for resource allocation (MRAs) have been introduced as a concept for modelling competitive resource allocation problems in distributed computing. An MRA is composed of a set of agents and a set of resources. Each agent…

Multiagent Systems · Computer Science 2022-09-21 Nils Timm , Josua Botha

This paper addresses key challenges in task scheduling for multi-tenant distributed systems, including dynamic resource variation, heterogeneous tenant demands, and fairness assurance. An adaptive scheduling method based on reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Xiaopei Zhang , Xingang Wang , Xin Wang

We investigate the problem of synthesizing optimal control policies for Markov decision processes (MDPs) with both qualitative and quantitative objectives. Specifically, our goal is to achieve a given linear temporal logic (LTL) task with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Yu Chen , Shaoyuan Li , Xiang Yin

This paper considers the problem of controller synthesis of signal temporal logic (STL) specifications for large-scale multi-agent systems, where the agents are dynamically coupled and subject to collaborative tasks. A compositional…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Siyuan Liu , Adnane Saoud , Dimos V. Dimarogonas

This paper investigates multi-agent frequencybased patrolling of intersecting, circle graphs under conditions where graph nodes have non-uniform visitation requirements and agents have limited ability to communicate. The task is modeled as…

Multiagent Systems · Computer Science 2014-02-10 Tao Mao , Laura Ray

We present a method to find an optimal policy with respect to a reward function for a discounted Markov decision process under general linear temporal logic (LTL) specifications. Previous work has either focused on maximizing a cumulative…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

Relational Markov Decision Processes are a useful abstraction for complex reinforcement learning problems and stochastic planning problems. Recent work developed representation schemes and algorithms for planning in such problems using the…

Artificial Intelligence · Computer Science 2012-06-26 Chenggang Wang , Roni Khardon

Factored Markov decision processes (MDPs) are a prominent paradigm within the artificial intelligence community for modeling and solving large-scale MDPs whose rewards and dynamics decompose into smaller, loosely interacting components.…

Optimization and Control · Mathematics 2024-04-03 Huikang Liu , Wolfram Wiesemann , Man-Chung Yue

Typical Multi-agent Path Finding (MAPF) solvers assume that agents move synchronously, thus neglecting the reality gap in timing assumptions, e.g., delays caused by an imperfect execution of asynchronous moves. So far, two policies enforce…

Multiagent Systems · Computer Science 2020-12-15 Keisuke Okumura , Yasumasa Tamura , Xavier Défago

In centralized multi-agent systems, often modeled as multi-agent partially observable Markov decision processes (MPOMDPs), the action and observation spaces grow exponentially with the number of agents, making the value and belief…

Artificial Intelligence · Computer Science 2024-02-26 Maris F. L. Galesloot , Thiago D. Simão , Sebastian Junges , Nils Jansen

We investigate a model for planning under uncertainty with temporallyextended actions, where multiple actions can be taken concurrently at each decision epoch. Our model is based on the options framework, and combines it with factored state…

Artificial Intelligence · Computer Science 2013-01-14 Khashayar Rohanimanesh , Sridhar Mahadevan