English
Related papers

Related papers: Hybrid BDI-POMDP Framework for Multiagent Teaming

200 papers

Markov Decision Processes (MDPs) are stochastic optimization problems that model situations where a decision maker controls a system based on its state. Partially observed Markov decision processes (POMDPs) are generalizations of MDPs where…

Optimization and Control · Mathematics 2019-03-26 Victor Cohen , Axel Parmentier

To enhance the ability for vehicle platoons to respond to emergency scenarios, a platoon distribution reorganization decision-making framework is proposed. This framework contains platoon distribution layer, vehicle cooperative…

Multiagent Systems · Computer Science 2025-06-23 Aijing Kong , Chengkai Xu , Xian Wu , Xinbo Chen , Peng Hang

We investigate improving Monte Carlo Tree Search based solvers for Partially Observable Markov Decision Processes (POMDPs), when applied to adaptive sampling problems. We propose improvements in rollout allocation, the action exploration…

Robotics · Computer Science 2021-09-27 Gautam Salhotra , Christopher E. Denniston , David A. Caron , Gaurav S. Sukhatme

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

Artificial Intelligence · Computer Science 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Mutual adaptation is a central challenge in human--AI teaming, as humans naturally adjust their strategies in response to a robot's policy. Existing approaches aim to improve diversity in training partners to approximate human behavior, but…

Robotics · Computer Science 2026-02-23 Upasana Biswas , Durgesh Kalwar , Subbarao Kambhampati , Sarath Sreedharan

Resource allocation is of crucial importance in wireless communications. However, it is extremely challenging to design efficient resource allocation schemes for future wireless communication networks since the formulated resource…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Fuhui Zhou , Rui Ding , Qihui Wu , Derrick Wing Kwan Ng , Kai-Kit Wong , Naofal Al-Dhahir

The main goal in task planning is to build a sequence of actions that takes an agent from an initial state to a goal state. In robotics, this is particularly difficult because actions usually have several possible results, and sensors are…

Artificial Intelligence · Computer Science 2021-04-12 Sergio A. Serrano , Elizabeth Santiago , Jose Martinez-Carranza , Eduardo Morales , L. Enrique Sucar

Partially Observable Markov Decision Processes (POMDP) is a widely used model to represent the interaction of an environment and an agent, under state uncertainty. Since the agent does not observe the environment state, its uncertainty is…

Artificial Intelligence · Computer Science 2021-04-16 Divya Grover , Christos Dimitrakakis

The Common Information (CI) approach provides a systematic way to transform a multi-agent stochastic control problem to a single-agent partially observed Markov decision problem (POMDP) called the coordinator's POMDP. However, such a POMDP…

Artificial Intelligence · Computer Science 2023-04-11 Dengwang Tang , Ashutosh Nayyar , Rahul Jain

Partially Observable Markov Decision Processes (POMDPs) are fundamental to many real-world applications. Although reinforcement learning (RL) has shown success in fully observable domains, learning policies from traces in partially…

Machine Learning · Computer Science 2025-08-05 Yuly Wu , Jiamou Liu , Libo Zhang

This paper considers an optimal task allocation problem for human robot collaboration in human robot systems with persistent tasks. Such human robot systems consist of human operators and intelligent robots collaborating with each other to…

Robotics · Computer Science 2017-06-02 Bo Wu , Bin Hu , Hai Lin

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

Robotics · Computer Science 2021-07-19 Hanna Kurniawati

Monotonic Partially Observable Markov Decision Processes (POMDPs), where the system state progressively decreases until a restorative action is performed, can be used to model sequential repair problems effectively. This paper considers the…

Machine Learning · Computer Science 2025-09-17 Manav Vora , Jonas Liang , Michael N. Grussing , Melkior Ornik

In this paper, we investigate learning temporal abstractions in cooperative multi-agent systems, using the options framework (Sutton et al, 1999). First, we address the planning problem for the decentralized POMDP represented by the…

Artificial Intelligence · Computer Science 2020-03-23 Jhelum Chakravorty , Nadeem Ward , Julien Roy , Maxime Chevalier-Boisvert , Sumana Basu , Andrei Lupu , Doina Precup

This paper studies multi-agent systems that involve networks of self-interested agents. We propose a Markov Decision Process-derived framework, called RepNet-MDP, tailored to domains in which agent reputation is a key driver of the…

Artificial Intelligence · Computer Science 2020-10-21 David Maoujoud , Gavin Rens

We consider the problem of interactive partially observable Markov decision processes (I-POMDPs), where the agents are located at the nodes of a communication network. Specifically, we assume a certain message type for all messages.…

Artificial Intelligence · Computer Science 2020-11-11 Yitao Chen , Deepanshu Vasal

This paper considers a novel approach to scalable multiagent resource allocation in dynamic settings. We propose an approximate solution in which each resource consumer is represented by an independent MDP-based agent that models expected…

Artificial Intelligence · Computer Science 2014-07-08 Hadi Hosseini , Jesse Hoey , Robin Cohen

In this work, we study the problem of actively classifying the attributes of dynamical systems characterized as a finite set of Markov decision process (MDP) models. We are interested in finding strategies that actively interact with the…

Systems and Control · Electrical Eng. & Systems 2023-01-06 Bo Wu , Niklas Lauffer , Mohamadreza Ahmadi , Suda Bharadwaj , Zhe Xu , Ufuk Topcu

A team of robots sharing a common goal can benefit from coordination of the activities of team members, helping the team to reach the goal more reliably or quickly. We address the problem of coordinating the actions of a team of robots with…

Robotics · Computer Science 2017-03-09 Mikko Lauri , Eero Heinänen , Simone Frintrop

Decentralized POMDPs provide an expressive framework for multi-agent sequential decision making. While fnite-horizon DECPOMDPs have enjoyed signifcant success, progress remains slow for the infnite-horizon case mainly due to the inherent…

Artificial Intelligence · Computer Science 2012-03-19 Akshat Kumar , Shlomo Zilberstein