English
Related papers

Related papers: Distributed Autonomous Swarm Formation for Dynamic…

200 papers

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

A cooperative robot swarm is a collective of computationally-limited robots that share a common goal. Each robot can only interact with a small subset of its peers, without knowing how this affects the collective utility. Recent advances in…

Robotics · Computer Science 2026-05-07 Erel Shtossel , Gal A. Kaminka

Most of the existing formation algorithms for multiagent systems are fully label-specified, i.e., the desired position for each agent in the formation is uniquely determined by its label, which would inevitably make the formation algorithms…

Robotics · Computer Science 2021-05-28 He Cai , Shuping Guo , Yuheng He , Jieyi Yan , Yingnan Zhen , Huanli Gao , Xiangyang Li

Multi-agent reinforcement learning has drawn increasing attention in practice, e.g., robotics and automatic driving, as it can explore optimal policies using samples generated by interacting with the environment. However, high reward…

Machine Learning · Computer Science 2022-10-17 Jifeng Hu , Yanchao Sun , Hechang Chen , Sili Huang , haiyin piao , Yi Chang , Lichao Sun

This paper investigates highly mobile vehicular networks from users' perspectives in highway transportation. Particularly, a centralized software-defined architecture is introduced in which centralized resources can be assigned, programmed,…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Md Ferdous Pervej , Shih-Chun Lin

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively improve observation…

When researching robot swarms, many studies observe complex group behavior emerging from the individual agents' simple local actions. However, the task of learning an individual policy to produce a desired group behavior remains a…

Artificial Intelligence · Computer Science 2025-12-16 Pranav Rajbhandari , Donald Sofge

This paper summarizes in depth the state of the art of aerial swarms, covering both classical and new reinforcement-learning-based approaches for their management. Then, it proposes a hybrid AI system, integrating deep reinforcement…

Artificial Intelligence · Computer Science 2025-01-16 Raúl Arranz , David Carramiñana , Gonzalo de Miguel , Juan A. Besada , Ana M. Bernardos

Due to information asymmetry, finding optimal policies for Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) is hard with the complexity growing doubly exponentially in the horizon length. The challenge increases…

Machine Learning · Computer Science 2021-10-26 Hsu Kao , Vijay Subramanian

This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity…

Machine Learning · Computer Science 2023-11-08 Yao Zhang , Zhiwen Yu , Jun Zhang , Liang Wang , Tom H. Luan , Bin Guo , Chau Yuen

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized…

Multiagent Systems · Computer Science 2019-06-07 Maximilian Hüttenrauch , Adrian Šošić , Gerhard Neumann

The coordination of robot swarms - large decentralized teams of robots - generally relies on robust and efficient inter-robot communication. Maintaining communication between robots is particularly challenging in field deployments.…

Robotics · Computer Science 2020-07-02 Vivek Shankar Varadharajan , David St-Onge , Bram Adams , Giovanni Beltrame

Unmanned aerial vehicles (UAVs) are increasingly used to support time-critical medical supply delivery, providing rapid and flexible logistics during emergencies and resource shortages. However, effective deployment of UAV fleets requires…

Machine Learning · Computer Science 2026-03-12 Islam Guven , Mehmet Parlak

The recent success of single-agent reinforcement learning (RL) in Internet of things (IoT) systems motivates the study of multi-agent reinforcement learning (MARL), which is more challenging but more useful in large-scale IoT. In this…

Machine Learning · Computer Science 2020-09-01 Yue Xu , Zengde Deng , Mengdi Wang , Wenjun Xu , Anthony Man-Cho So , Shuguang Cui

In disaster scenarios, establishing robust emergency communication networks is critical, and unmanned aerial vehicles (UAVs) offer a promising solution to rapidly restore connectivity. However, organizing UAVs to form multi-hop networks in…

Multiagent Systems · Computer Science 2026-03-19 Yanggang Xu , Jirong Zha , Weijie Hong , Xiangmin Yi , Geng Chen , Jianfeng Zheng , Chen-Chun Hsia , Xinlei Chen

Consider a swarm of particles controlled by global inputs. This paper presents algorithms for shaping such swarms in 2D using boundary walls. The range of configurations created by conforming a swarm to a boundary wall is limited. We…

Robotics · Computer Science 2016-09-08 Shiva Shahrokhi , Arun Mahadev , Aaron T. Becker

The deployment of unmanned aerial vehicle (UAV) swarm-assisted communication networks has become an increasingly vital approach for remediating coverage limitations in infrastructure-deficient environments, with especially pressing…

Machine Learning · Computer Science 2025-09-30 Tianjiao Sun , Ningyan Guo , Haozhe Gu , Yanyan Peng , Zhiyong Feng

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu

This paper presents a data-driven decentralized trajectory optimization approach for multi-robot motion planning in dynamic environments. When navigating in a shared space, each robot needs accurate motion predictions of neighboring robots…

Robotics · Computer Science 2021-02-25 Hai Zhu , Francisco Martinez Claramunt , Bruno Brito , Javier Alonso-Mora

Swarms of unmanned aerial vehicles (UAVs) are increasingly becoming vital to our society, undertaking tasks such as search and rescue, surveillance and delivery. A special variant of Distributed Model Predictive Control (DMPC) has emerged…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Alexander Gräfe , Joram Eickhoff , Marco Zimmerling , Sebastian Trimpe