English
Related papers

Related papers: An Actor-Critic-Based UAV-BSs Deployment Method fo…

200 papers

Reinforcement Learning (RL) has recently found wide applications in network traffic management and control because some of its variants do not require prior knowledge of network models. In this paper, we present a novel scheduler for…

Networking and Internet Architecture · Computer Science 2022-04-29 Achilles Machumilane , Alberto Gotta , Pietro Cassarà , Claudio Gennaro , Giuseppe Amato

This work studies the application of Multi-Agent Reinforcement Learning (MARL) to decentralized control of unmanned aerial vehicles to relay a critical data package to a known position. For this purpose, a family of deterministic games is…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Mika Persson , Jonas Lidman , Jacob Ljungberg , Samuel Sandelius , Adam Andersson

In the last decade, data-driven approaches have become popular choices for quadrotor control, thanks to their ability to facilitate the adaptation to unknown or uncertain flight conditions. Among the different data-driven paradigms, Deep…

Robotics · Computer Science 2024-12-30 Alberto Dionigi , Gabriele Costante , Giuseppe Loianno

Autonomous UAV inspection of confined industrial infrastructure, such as ventilation ducts, demands robust navigation policies where collisions are unacceptable. While Deep Reinforcement Learning (DRL) offers a powerful paradigm for…

In this paper, we design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed to improve the data freshness and connectivity to the Internet of Things (IoT) devices. First, we…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Sarder Fakhrul Abedin , Md. Shirajum Munir , Nguyen H. Tran , Zhu Han , Choong Seon Hong

Fast and reliable connectivity is essential to enhancing situational awareness and operational efficiency for public safety mission-critical (MC) users. In emergency or disaster circumstances, where existing cellular network coverage and…

Machine Learning · Computer Science 2024-10-28 Hongyi Zhang , Jingya Li , Zhiqiang Qi , Xingqin Lin , Anders Aronsson , Jan Bosch , Helena Holmström Olsson

Unmanned Aerial Vehicles (UAVs) possess high mobility and flexible deployment capabilities, prompting the development of UAVs for various application scenarios within the Internet of Things (IoT). The unique capabilities of UAVs give rise…

Artificial Intelligence · Computer Science 2024-12-16 Xin Tang , Qian Chen , Wenjie Weng , Binhan Liao , Jiacheng Wang , Xianbin Cao , Xiaohuan Li

Next-generation wireless networks will deploy UAVs dynamically as aerial base stations (UAV-BSs) to boost the wireless network coverage in the out of reach areas. To provide an efficient service in stochastic environments, the optimal…

Networking and Internet Architecture · Computer Science 2022-07-29 Shavbo Salehi , Jahan Hassan , Ayub Bokani

Decision-making for engineering systems can be efficiently formulated as a Markov Decision Process (MDP) or a Partially Observable MDP (POMDP). Typical MDP and POMDP solution procedures utilize offline knowledge about the environment and…

Systems and Control · Computer Science 2018-11-07 C. P. Andriotis , K. G. Papakonstantinou

In critical situations such as natural disasters, network outages, battlefield communication, or large-scale public events, Unmanned Aerial Vehicles (UAVs) offer a promising approach to maximize wireless coverage for affected users in the…

Networking and Internet Architecture · Computer Science 2025-07-09 Xuli Cai , Poonam Lohan , Burak Kantarci

We study the joint active/passive beamforming and channel blocklength (CBL) allocation in a non-ideal reconfigurable intelligent surface (RIS)-aided ultra-reliable and low-latency communication (URLLC) system. The considered scenario is a…

Information Theory · Computer Science 2024-10-28 Ramin Hashemi , Samad Ali , Nurul Huda Mahmood , Matti Latva-aho

In this paper, a machine learning based deployment framework of unmanned aerial vehicles (UAVs) is studied. In the considered model, UAVs are deployed as flying base stations (BS) to offload heavy traffic from ground BSs. Due to…

Signal Processing · Electrical Eng. & Systems 2020-07-31 Linyan Lu , Zhaohui Yang , Mingzhe Chen , Zelin Zang , Mohammad Shikh-Bahaei

Maritime autonomous transportation has played a crucial role in the globalization of the world economy. Deep Reinforcement Learning (DRL) has been applied to automatic path planning to simulate vessel collision avoidance situations in open…

Artificial Intelligence · Computer Science 2021-06-29 Nader Zare , Bruno Brandoli , Mahtab Sarvmaili , Amilcar Soares , Stan Matwin

Recently, Unmanned Aerial Vehicles (UAVs) are increasingly being investigated to collect sensory data in post-disaster monitoring scenarios, such as tsunamis, where early actions are critical to limit coastal damage. A major challenge is to…

Artificial Intelligence · Computer Science 2025-10-08 Yousef Emami , Seyedsina Nabavirazavi , Jingjing Zheng , Hao Zhou , Miguel Gutierrez Gaitan , Kai Li , Luis Almeida

Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous…

Machine Learning · Computer Science 2023-05-04 Gang Chen , Victoria Huang

Owing to the unique advantages of low cost and controllability, reconfigurable intelligent surface (RIS) is a promising candidate to address the blockage issue in millimeter wave (mmWave) communication systems, consequently has captured…

Information Theory · Computer Science 2022-02-24 Yuqian Zhu , Zhu Bo , Ming Li , Yang Liu , Qian Liu , Zheng Chang , Yulin Hu

The capability of UAVs for efficient autonomous navigation and obstacle avoidance in complex and unknown environments is critical for applications in agricultural irrigation, disaster relief and logistics. In this paper, we propose the DPRL…

Robotics · Computer Science 2024-12-10 Junqiao Wang , Zhongliang Yu , Dong Zhou , Jiaqi Shi , Runran Deng

Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, have the potential to significantly reduce fuel consumption and travel time in real-world driving conditions. In particular, the Eco-driving problem…

Systems and Control · Electrical Eng. & Systems 2023-09-21 Zhaoxuan Zhu , Shobhit Gupta , Abhishek Gupta , Marcello Canova

Cellular-connected unmanned aerial vehicle (UAV) is a promising technology to unlock the full potential of UAVs in the future. However, how to achieve ubiquitous three-dimensional (3D) communication coverage for the UAVs in the sky is a new…

Signal Processing · Electrical Eng. & Systems 2020-03-18 Yong Zeng , Xiaoli Xu , Shi Jin , Rui Zhang

This paper proposes a fully dynamic Deep Reinforcement Learning (DRL) method for rebalancing dockless bike-sharing systems, overcoming the limitations of periodic, system-wide interventions. We model the service through a graph-based…

Systems and Control · Electrical Eng. & Systems 2026-05-15 Edoardo Scarpel , Alberto Pettena , Matteo Cederle , Federico Chiariotti , Marco Fabris , Gian Antonio Susto