English
Related papers

Related papers: Deep Reinforcement Learning for UAV Navigation Thr…

200 papers

The Autonomy of Unmanned Aerial Vehicles (UAVs) in indoor environments poses significant challenges due to the lack of reliable GPS signals in enclosed spaces such as warehouses, factories, and indoor facilities. Micro Aerial Vehicles…

Robotics · Computer Science 2025-04-09 Amit Kumar Singh , Prasanth Kumar Duba , P. Rajalakshmi

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectory in multi-UAV non-cooperative scenarios while collecting data from distributed Internet of Things (IoT) nodes…

Signal Processing · Electrical Eng. & Systems 2023-12-12 Xueyuan Wang , M. Cenk Gursoy , Tugba Erpek , Yalin E. Sagduyu

In this paper, we propose a novel deep Q-network (DQN)-based edge selection algorithm designed specifically for real-time surveillance in unmanned aerial vehicle (UAV) networks. The proposed algorithm is designed under the consideration of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Soohyun Park , Jeman Park , David Mohaisen , Joongheon Kim

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks. In this paper, we aim to find collision-free paths for multiple cellular-connected UAVs, while satisfying requirements of connectivity with ground…

Machine Learning · Computer Science 2021-04-19 Xueyuan Wang , M. Cenk Gursoy , Tugba Erpek , Yalin E. Sagduyu

In this paper, we design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed to improve the data freshness and connectivity to the Internet of Things (IoT) devices. First, we…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Sarder Fakhrul Abedin , Md. Shirajum Munir , Nguyen H. Tran , Zhu Han , Choong Seon Hong

In this paper, we study a joint detection, mapping and navigation problem for a single unmanned aerial vehicle (UAV) equipped with a low complexity radar and flying in an unknown environment. The goal is to optimize its trajectory with the…

Robotics · Computer Science 2020-07-23 Anna Guerra , Francesco Guidi , Davide Dardari , Petar M. Djuric

The choice of the transmitting frequency to provide cellular-connected Unmanned Aerial Vehicle (UAV) reliable connectivity and mobility support introduce several challenges. Conventional sub-6 GHz networks are optimized for ground Users…

Signal Processing · Electrical Eng. & Systems 2021-08-30 Gianluca Fontanesi , Anding Zhu , Hamed Ahmadi

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

Unmanned aerial vehicle (UAV)-assisted data collection has been emerging as a prominent application due to its flexibility, mobility, and low operational cost. However, under the dynamic and uncertainty of IoT data collection and energy…

Networking and Internet Architecture · Computer Science 2021-06-22 Nam H. Chu , Dinh Thai Hoang , Diep N. Nguyen , Nguyen Van Huynh , Eryk Dutkiewicz

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

CCTV-based surveillance using unmanned aerial vehicles (UAVs) is considered a key technology for security in smart city environments. This paper creates a case where the UAVs with CCTV-cameras fly over the city area for flexible and…

Systems and Control · Electrical Eng. & Systems 2022-01-19 Won Joon Yun , Soohyun Park , Joongheon Kim , MyungJae Shin , Soyi Jung , David A. Mohaisen , Jae-Hyun Kim

Unmanned aerial vehicle (UAV)-based networks and Internet of Things (IoT) are being considered as integral components of current and next-generation wireless networks. In particular, UAVs can provide IoT devices with seamless connectivity…

Systems and Control · Electrical Eng. & Systems 2023-12-12 Xueyuan Wang , M. Cenk Gursoy

Unmanned Aerial Vehicles (UAVs) with Microwave Power Transfer (MPT) capability provide a practical means to deploy a large number of wireless powered sensing devices into areas with no access to persistent power supplies. The UAV can charge…

Networking and Internet Architecture · Computer Science 2019-06-18 Kai Li , Wei Ni , Eduardo Tovar

This paper presents a comprehensive literature review on applications of deep reinforcement learning in communications and networking. Modern networks, e.g., Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) networks, become more…

Networking and Internet Architecture · Computer Science 2018-10-19 Nguyen Cong Luong , Dinh Thai Hoang , Shimin Gong , Dusit Niyato , Ping Wang , Ying-Chang Liang , Dong In Kim

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

We consider the problem of designing scalable and portable controllers for unmanned aerial vehicles (UAVs) to reach time-varying formations as quickly as possible. This brief confirms that deep reinforcement learning can be used in a…

Robotics · Computer Science 2017-06-06 Ronny Conde , José Ramón Llata , Carlos Torre-Ferrero

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectories for multiple UAVs while satisfying requirements of connectivity with ground base stations (GBSs) is a…

Robotics · Computer Science 2021-04-19 Xueyuan Wang , M. Cenk Gursoy

Unmanned aerial vehicles (UAV) are commonly used for missions in unknown environments, where an exact mathematical model of the environment may not be available. This paper provides a framework for using reinforcement learning to allow the…

Robotics · Computer Science 2018-01-17 Huy X. Pham , Hung M. La , David Feil-Seifer , Luan V. Nguyen

Unmanned Surface Vehicles technology (USVs) is an exciting topic that essentially deploys an algorithm to safely and efficiently performs a mission. Although reinforcement learning is a well-known approach to modeling such a task,…

Machine Learning · Computer Science 2020-03-24 Mohammad Etemad , Nader Zare , Mahtab Sarvmaili , Amilcar Soares , Bruno Brandoli Machado , Stan Matwin