English
Related papers

Related papers: Learning for Multi-robot Cooperation in Partially …

200 papers

This paper addresses the problem of optimal control of robotic sensing systems aimed at autonomous information gathering in scenarios such as environmental monitoring, search and rescue, and surveillance and reconnaissance. The information…

Systems and Control · Computer Science 2016-01-28 Mikko Lauri , Nikolay Atanasov , George J. Pappas , Risto Ritala

This paper considers an optimal task allocation problem for human robot collaboration in human robot systems with persistent tasks. Such human robot systems consist of human operators and intelligent robots collaborating with each other to…

Robotics · Computer Science 2017-06-02 Bo Wu , Bin Hu , Hai Lin

Developing a safe and efficient collision avoidance policy for multiple robots is challenging in the decentralized scenarios where each robot generate its paths without observing other robots' states and intents. While other distributed…

Robotics · Computer Science 2018-05-22 Pinxin Long , Tingxiang Fan , Xinyi Liao , Wenxi Liu , Hao Zhang , Jia Pan

The main goal in task planning is to build a sequence of actions that takes an agent from an initial state to a goal state. In robotics, this is particularly difficult because actions usually have several possible results, and sensors are…

Artificial Intelligence · Computer Science 2021-04-12 Sergio A. Serrano , Elizabeth Santiago , Jose Martinez-Carranza , Eduardo Morales , L. Enrique Sucar

Decentralized partially observable Markov decision processes with communication (Dec-POMDP-Com) provide a framework for multiagent decision making under uncertainty, but the NEXP-complete complexity for finite-horizon problems renders…

Multiagent Systems · Computer Science 2025-11-18 Dylan M. Asmar , Mykel J. Kochenderfer

This paper presents a novel partial differential equation (PDE)-based framework for controlling an ensemble of robots, which have limited sensing and actuation capabilities and exhibit stochastic behaviors, to perform mapping and coverage…

Systems and Control · Computer Science 2017-11-30 Karthik Elamvazhuthi , Hendrik Kuiper , Spring Berman

Recent reinforcement learning (RL) methods have achieved success in various domains. However, multi-agent RL (MARL) remains a challenge in terms of decentralization, partial observability and scalability to many agents. Meanwhile,…

Machine Learning · Computer Science 2024-02-26 Kai Cui , Sascha Hauck , Christian Fabian , Heinz Koeppl

Distributed model predictive control (DMPC) is a flexible and scalable feedback control method applicable to a wide range of systems. While the stability analysis of DMPC is quite well understood, there exist only limited implementation…

Systems and Control · Electrical Eng. & Systems 2025-11-05 Gösta Stomberg , Henrik Ebel , Timm Faulwasser , Peter Eberhard

Many processes, such as discrete event systems in engineering or population dynamics in biology, evolve in discrete space and continuous time. We consider the problem of optimal decision making in such discrete state and action space…

Machine Learning · Computer Science 2020-10-27 Bastian Alt , Matthias Schultheis , Heinz Koeppl

In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…

Optimization and Control · Mathematics 2019-03-07 Donghwan Lee , Niao He , Jianghai Hu

In human-robot collaboration, the objectives of the human are often unknown to the robot. Moreover, even assuming a known objective, the human behavior is also uncertain. In order to plan a robust robot behavior, a key preliminary question…

Robotics · Computer Science 2023-02-28 Yang You , Vincent Thomas , Francis Colas , Rachid Alami , Olivier Buffet

Distributed model predictive control (DMPC) is promising in achieving optimal cooperative control in multirobot systems (MRS). However, real-time DMPC implementation relies on numerical optimization tools to periodically calculate local…

Robotics · Computer Science 2024-12-30 Xinglong Zhang , Wei Pan , Cong Li , Xin Xu , Xiangke Wang , Ronghua Zhang , Dewen Hu

The framework of mixed observable Markov decision processes (MOMDP) models many robotic domains in which some state variables are fully observable while others are not. In this work, we identify a significant subclass of MOMDPs defined by…

Robotics · Computer Science 2022-06-07 Hai Nguyen , Zhihan Yang , Andrea Baisero , Xiao Ma , Robert Platt , Christopher Amato

Decentralized partially observable Markov decision processes (Dec-POMDPs) formalize the problem of designing individual controllers for a group of collaborative agents under stochastic dynamics and partial observability. Seeking a global…

Artificial Intelligence · Computer Science 2023-05-22 Yang You , Vincent Thomas , Francis Colas , Olivier Buffet

Collaborative robots, or cobots, are increasingly integrated into various industrial and service settings to work efficiently and safely alongside humans. However, for effective human-robot collaboration, robots must reason based on human…

Robotics · Computer Science 2026-01-22 Muhammad Adel Yusuf , Ali Nasir , Zeeshan Hameed Khan

Partially Observable Markov Decision Processes (POMDPs) are systems in which one agent interacts with a stochastic environment, and receives only partial information about the current state. In a multi-environment POMDP (MEPOMDP), the…

Artificial Intelligence · Computer Science 2026-05-11 Léonard Brice , Filip Cano , Krishnendu Chatterjee , Thomas A. Henzinger , Stefanie Muroya

We propose a decentralized, learning-based framework for dynamic coalition formation in Multi-Robot Task Allocation (MRTA). Our approach extends MAPPO by integrating spatial action maps, robot motion planning, intention sharing, and task…

Robotics · Computer Science 2025-07-18 Lucas C. D. Bezerra , Ataíde M. G. dos Santos , Shinkyu Park

This paper deals with the question of how to most effectively conduct experiments in Partially Observed Markov Decision Processes so as to provide data that is most informative about a parameter of interest. Methods from Markov decision…

Other Statistics · Statistics 2018-01-31 Leifur Thorbergsson , Giles Hooker

Optimal decision-making presents a significant challenge for autonomous systems operating in uncertain, stochastic and time-varying environments. Environmental variability over time can significantly impact the system's optimal decision…

Robotics · Computer Science 2024-03-11 Gokul Puthumanaillam , Xiangyu Liu , Negar Mehr , Melkior Ornik

The centralized training for decentralized execution paradigm emerged as the state-of-the-art approach to $\epsilon$-optimally solving decentralized partially observable Markov decision processes. However, scalability remains a significant…

Machine Learning · Computer Science 2025-01-14 Johan Peralez , Aurèlien Delage , Jacopo Castellini , Rafael F. Cunha , Jilles S. Dibangoye