English
Related papers

Related papers: Resource Allocation Among Agents with MDP-Induced …

200 papers

In many domains such as transportation and logistics, search and rescue, or cooperative surveillance, tasks are pending to be allocated with the consideration of possible execution uncertainties. Existing task coordination algorithms either…

Multiagent Systems · Computer Science 2023-08-03 Ruifan Liu , Hyo-Sang Shin , Binbin Yan , Antonios Tsourdos

In this paper we study the problem of allocating a scarce resource among several players (or agents). A central decision maker wants to maximize the total utility of all agents. However, such a solution may be unfair for one or more agents…

Computer Science and Game Theory · Computer Science 2016-11-21 Gaia Nicosia , Andrea Pacifici , Ulrich Pferschy

In this paper we consider multiple constrained resource allocation problems, where the constraints can be specified by formulating activity dependency restrictions or by using game-theoretic models. All the problems are focused on generic…

Data Structures and Algorithms · Computer Science 2009-06-19 Mugurel Ionut Andreica , Madalina Ecaterina Andreica , Costel Visan

We study capacity- and budget-constrained multi-agent MDPs (CB-MA-MDPs), a class that captures many maintenance and scheduling tasks in which each agent can irreversibly fail and a planner must decide (i) when to apply a restorative action…

Machine Learning · Computer Science 2025-10-08 Manav Vora , Ilan Shomorony , Melkior Ornik

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

Constrained decision-making is essential for designing safe policies in real-world control systems, yet simulated environments often fail to capture real-world adversities. We consider the problem of learning a policy that will maximize the…

Machine Learning · Computer Science 2026-02-10 Sourav Ganguly , Kishan Panaganti , Arnob Ghosh , Adam Wierman

Graph games are fundamental in strategic reasoning of multi-agent systems and their environments. We study a new family of graph games which combine stochastic environmental uncertainties and auction-based interactions among the agents,…

Computer Science and Game Theory · Computer Science 2024-12-30 Guy Avni , Martin Kurečka , Kaushik Mallik , Petr Novotný , Suman Sadhukhan

This paper deals with solving distributed optimization problems with equality constraints by a class of uncertain nonlinear heterogeneous dynamic multi-agent systems. It is assumed that each agent with an uncertain dynamic model has limited…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Mohammad Saeed Sarafraz , Mohammad Saleh Tavazoei

In the standard model of fair allocation of resources to agents, every agent has some utility for every resource, and the goal is to assign resources to agents so that the agents' welfare is maximized. Motivated by job scheduling, interest…

Computer Science and Game Theory · Computer Science 2024-03-08 Susobhan Bandopadhyay , Aritra Banik , Sushmita Gupta , Pallavi Jain , Abhishek Sahu , Saket Saurabh , Prafullkumar Tale

We study the synthesis of a policy in a Markov decision process (MDP) following which an agent reaches a target state in the MDP while minimizing its total discounted cost. The problem combines a reachability criterion with a discounted…

Optimization and Control · Mathematics 2021-03-18 Yagiz Savas , Christos K. Verginis , Michael Hibbard , Ufuk Topcu

The main goal of this paper is to investigate continuous-time distributed dynamic programming (DP) algorithms for networked multi-agent Markov decision problems (MAMDPs). In our study, we adopt a distributed multi-agent framework where…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Donghwan Lee , Han-Dong Lim , Do Wan Kim

Auction has been used to allocate resources or tasks to processes, machines or other autonomous entities in distributed systems. When different bidders have different demands and valuations on different types of resources or tasks, the…

Computer Science and Game Theory · Computer Science 2019-02-26 Li-Hsing Yen , Guang-Hong Sun

In the Markov decision process model, policies are usually evaluated by expected cumulative rewards. As this decision criterion is not always suitable, we propose in this paper an algorithm for computing a policy optimal for the quantile…

Artificial Intelligence · Computer Science 2016-12-02 Hugo Gilbert , Paul Weng , Yan Xu

In this paper, the distributed resource allocation optimization problem is investigated. The allocation decisions are made to minimize the sum of all the agents' local objective functions while satisfying both the global network resource…

Optimization and Control · Mathematics 2017-04-11 Peng Yi , Yiguang Hong , Feng Liu

Multi-agent systems are designed to concurrently accomplish a diverse set of tasks at unprecedented scale. Here, the central problems faced by a system operator are to decide (i) how to divide available resources amongst the agents assigned…

Systems and Control · Electrical Eng. & Systems 2021-04-01 Keith Paarporn , Rahul Chandan , Mahnoosh Alizadeh , Jason R. Marden

We consider the problem of controlling a fully specified Markov decision process (MDP), also known as the planning problem, when the state space is very large and calculating the optimal policy is intractable. Instead, we pursue the more…

Optimization and Control · Mathematics 2019-01-09 Yasin Abbasi-Yadkori , Peter L. Bartlett , Xi Chen , Alan Malek

This paper proposes networked dynamics to solve resource allocation problems over time-varying multi-agent networks. The state of each agent represents the amount of used resources (or produced utilities) while the total amount of resources…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Mohammadreza Doostmohammadian , Alireza Aghasi , Mohammad Pirani , Ehsan Nekouei , Usman A. Khan , Themistoklis Charalambous

When facing many options, we narrow down our focus to very few of them. Although behaviors like this can be a sign of heuristics, they can actually be optimal under limited cognitive resources. Here we study the problem of how to optimally…

Neurons and Cognition · Quantitative Biology 2021-02-03 Jorge Ramírez-Ruiz , Rubén Moreno-Bote

A decisionmaker faces $n$ alternatives, each of which represents a potential reward. After investing costly resources into investigating the alternatives, the decisionmaker may select one, or more generally a feasible subset, and obtain the…

Computer Science and Game Theory · Computer Science 2026-04-02 Robin Bowers , Elias Lindgren , Bo Waggoner

We introduce and study constrained Markov Decision Processes (cMDPs) with anytime constraints. An anytime constraint requires the agent to never violate its budget at any point in time, almost surely. Although Markovian policies are no…

Machine Learning · Computer Science 2024-06-14 Jeremy McMahan , Xiaojin Zhu