English
Related papers

Related papers: DSSE: a drone swarm search environment

200 papers

Using drone base stations (drone-BSs) in wireless networks has started attracting attention. Drone-BSs can assist the ground BSs in both capacity and coverage enhancement. One of the important problems about integrating drone-BSs to…

Networking and Internet Architecture · Computer Science 2018-04-24 Elham Kalantari , Halim Yanikomeroglu , Abbas Yongacoglu

Researchers have demonstrated that Deep Reinforcement Learning (DRL) is a powerful tool for finding policies that perform well on complex robotic systems. However, these policies are often unpredictable and can induce highly variable…

Robotics · Computer Science 2022-03-08 Sean Gillen , Asutay Ozmen , Katie Byl

Efficient traffic monitoring is crucial for managing urban transportation networks, especially under congested and dynamically changing traffic conditions. Drones offer a scalable and cost-effective alternative to fixed sensor networks.…

Systems and Control · Electrical Eng. & Systems 2025-03-28 Marko Maljkovic , Nikolas Geroliminis

Drones are a promising technology for autonomous data collection and indoor sensing. In situations when human-controlled UAVs may not be practical or dependable, such as in uncharted or dangerous locations, the usage of autonomous UAVs…

Robotics · Computer Science 2023-04-19 Aswin Iyer , Santosh Narayan , Naren M , Manoj kumar Rajagopal

This paper introduces the PettingZoo library and the accompanying Agent Environment Cycle ("AEC") games model. PettingZoo is a library of diverse sets of multi-agent environments with a universal, elegant Python API. PettingZoo was…

Swarm robotics is envisioned to automate a large number of dirty, dangerous, and dull tasks. Robots have limited energy, computation capability, and communication resources. Therefore, current swarm robotics have a small number of robots,…

Robotics · Computer Science 2023-08-23 Xiucheng Wang , Hongzhi Guo

Drones are promising for data collection in precision agriculture, however, they are limited by their battery capacity. Efficient path planners are therefore required. This paper presents a drone path planner trained using Reinforcement…

Robotics · Computer Science 2025-05-15 Rick van Essen , Gert Kootstra

Rapidly generating an optimal chasing motion of a drone to follow a dynamic target among obstacles is challenging due to numerical issues rising from multiple conflicting objectives and non-convex constraints. This study proposes to resolve…

Robotics · Computer Science 2021-12-14 Boseong Felipe Jeon , Changhyeon Kim , Hojoon Shin , H. Jin Kim

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots. Recent deep reinforcement learning approaches show promising results to solve the problem, but it is not solved yet, as they typically…

Robotics · Computer Science 2022-10-21 Diego Martinez , Luis Riazuelo , Luis Montano

This note presents an analytical framework for decision-making in drone swarm systems operating under uncertainty, based on the integration of Partially Observable Markov Decision Processes (POMDP) with Deep Deterministic Policy Gradient…

Optimization and Control · Mathematics 2025-11-17 Michael Z. Zgurovsky , Pavlo O. Kasyanov , Liliia S. Paliichuk

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Artificial Intelligence · Computer Science 2025-12-02 Riley Simmons-Edler , Ryan P. Badman , Felix Baastad Berg , Raymond Chua , John J. Vastola , Joshua Lunger , William Qian , Kanaka Rajan

This research proposes a new integrated framework for identifying safe landing locations and planning in-flight divert maneuvers. The state-of-the-art algorithms for landing zone selection utilize local terrain features such as slopes and…

Robotics · Computer Science 2021-02-25 Keidai Iiyama , Kento Tomita , Bhavi A. Jagatia , Tatsuwaki Nakagawa , Koki Ho

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Non-terrestrial networks (NTNs) with low-earth orbit (LEO) satellites have been regarded as promising remedies to support global ubiquitous wireless services. Due to the rapid mobility of LEO satellite, inter-beam/satellite handovers happen…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Yang Cao , Shao-Yu Lien , Ying-Chang Liang , Dusit Niyato , Xuemin , Shen

We demonstrate the possibility of learning drone swarm controllers that are zero-shot transferable to real quadrotors via large-scale multi-agent end-to-end reinforcement learning. We train policies parameterized by neural networks that are…

Robotics · Computer Science 2021-11-23 Sumeet Batra , Zhehui Huang , Aleksei Petrenko , Tushar Kumar , Artem Molchanov , Gaurav S. Sukhatme

Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an…

Networking and Internet Architecture · Computer Science 2023-05-19 Jinqiang Li , Miao Ye , Linqiang Huang , Xiaofang Deng , Hongbing Qiu , Yong Wang

Drones are becoming indispensable in many application domains. In data-driven missions, besides sensing, the drone must process the collected data at runtime to decide whether additional action must be taken on the spot, before moving to…

Robotics · Computer Science 2025-12-05 Giorgos Polychronis , Foivos Pournaropoulos , Christos D. Antonopoulos , Spyros Lalis

This research addresses the challenge of performing search missions in dynamic environments, particularly for drifting targets whose movement is dictated by a flow field. This is accomplished through a dynamical system that integrates two…

Robotics · Computer Science 2025-11-04 Luka Lanča , Karlo Jakac , Sylvain Calinon , Stefan Ivić

Autonomous navigation in unstructured environments is essential for field and planetary robotics, where robots must efficiently reach goals while avoiding obstacles under uncertain conditions. Conventional algorithmic approaches often…

Robotics · Computer Science 2025-10-28 Shreya Santra , Thomas Robbins , Kazuya Yoshida

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao