English
Related papers

Related papers: UAV Target Tracking in Urban Environments Using De…

200 papers

The fifth and sixth generations of wireless communication networks are enabling tools such as internet of things devices, unmanned aerial vehicles (UAVs), and artificial intelligence, to improve the agricultural landscape using a network of…

Networking and Internet Architecture · Computer Science 2022-09-16 Anne Catherine Nguyen , Turgay Pamuklu , Aisha Syed , W. Sean Kennedy , Melike Erol-Kantarci

In this paper, we propose a novel deep Q-network (DQN)-based edge selection algorithm designed specifically for real-time surveillance in unmanned aerial vehicle (UAV) networks. The proposed algorithm is designed under the consideration of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Soohyun Park , Jeman Park , David Mohaisen , Joongheon Kim

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Data packet routing in aeronautical ad-hoc networks (AANETs) is challenging due to their high-dynamic topology. In this paper, we invoke deep reinforcement learning for routing in AANETs aiming at minimizing the end-to-end (E2E) delay.…

Networking and Internet Architecture · Computer Science 2021-10-29 Dong Liu , Jingjing Cui , Jiankang Zhang , Chenyang Yang , Lajos Hanzo

Active target sensing is the task of discovering and classifying an unknown number of targets in an environment and is critical in search-and-rescue missions. This paper develops a deep reinforcement learning approach to plan informative…

Robotics · Computer Science 2022-12-19 Harsh Goel , Laura Jarin Lipschitz , Saurav Agarwal , Sandeep Manjanna , Vijay Kumar

Decision making for autonomous driving in urban environments is challenging due to the complexity of the road structure and the uncertainty in the behavior of diverse road users. Traditional methods consist of manually designed rules as the…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Niranjan Deshpande , Dominique Vaufreydaz , Anne Spalanzani

We solve active target tracking, one of the essential tasks in autonomous systems, using a deep reinforcement learning (RL) approach. In this problem, an autonomous agent is tasked with acquiring information about targets of interests using…

Machine Learning · Computer Science 2020-06-19 Heejin Jeong , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G communication infrastructure in future smart cities. Hot spots easily appear in road intersections, where effective communication among vehicles is challenging. UAVs may…

Machine Learning · Computer Science 2023-02-22 Ming Zhu , Xiao-Yang Liu , Anwar Walid

Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new target goals, and (2) data inefficiency i.e., the model requires several (and often costly) episodes of trial and error to converge,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-19 Yuke Zhu , Roozbeh Mottaghi , Eric Kolve , Joseph J. Lim , Abhinav Gupta , Li Fei-Fei , Ali Farhadi

Unmanned Aerial Vehicles (UAV) have been standing out due to the wide range of applications in which they can be used autonomously. However, they need intelligent systems capable of providing a greater understanding of what they perceive to…

Robotics · Computer Science 2022-09-15 Matheus G. Mateus , Ricardo B. Grando , Paulo L. J. Drews-Jr

In this letter, we study the energy efficiency (EE) optimisation of unmanned aerial vehicles (UAVs) providing wireless coverage to static and mobile ground users. Recent multi-agent reinforcement learning approaches optimise the system's EE…

Networking and Internet Architecture · Computer Science 2022-04-05 Babatunji Omoniwa , Boris Galkin , Ivana Dusparic

We develop a deep reinforcement learning method for training a jellyfish-like swimmer to effectively track a moving target in a two-dimensional flow. This swimmer is a flexible object equipped with a muscle model based on torsional springs.…

Fluid Dynamics · Physics 2025-08-20 Yihao Chen , Yue Yang

This paper introduces Q-learning with gradient target tracking, a novel reinforcement learning framework that provides a learned continuous target update mechanism as an alternative to the conventional hard update paradigm. In the standard…

Machine Learning · Computer Science 2025-07-21 Bum Geun Park , Taeho Lee , Donghwan Lee

Unmanned Aerial Vehicles (UAV) can pose a major risk for aviation safety, due to both negligent and malicious use. For this reason, the automated detection and tracking of UAV is a fundamental task in aerial security systems. Common…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Brian K. S. Isaac-Medina , Matt Poyser , Daniel Organisciak , Chris G. Willcocks , Toby P. Breckon , Hubert P. H. Shum

Unmanned aerial vehicles (UAVs) have emerged as a promising auxiliary platform for smart agriculture, capable of simultaneously performing weed detection, recognition, and data collection from wireless sensors. However, trajectory planning…

Machine Learning · Computer Science 2025-12-23 Wencan Mao , Quanxi Zhou , Tomas Couso Coddou , Manabu Tsukada , Yunling Liu , Yusheng Ji

Landing an unmanned aerial vehicle (UAV) on a ground marker is an open problem despite the effort of the research community. Previous attempts mostly focused on the analysis of hand-crafted geometric features and the use of external sensors…

Artificial Intelligence · Computer Science 2018-02-28 Riccardo Polvara , Massimiliano Patacchiola , Sanjay Sharma , Jian Wan , Andrew Manning , Robert Sutton , Angelo Cangelosi

The unmanned aerial vehicle (UAV) is one of the technological breakthroughs that supports a variety of services, including communications. UAV will play a critical role in enhancing the physical layer security of wireless networks. This…

Information Theory · Computer Science 2021-12-22 Aly Sabri Abdalla , Ali Behfarnia , Vuk Marojevic

Multi-object tracking (MOT) is a crucial component of situational awareness in military defense applications. With the growing use of unmanned aerial systems (UASs), MOT methods for aerial surveillance is in high demand. Application of MOT…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Wanlin Xie , Jaime Ide , Daniel Izadi , Sean Banger , Thayne Walker , Ryan Ceresani , Dylan Spagnuolo , Christopher Guagliano , Henry Diaz , Jason Twedt

Unmanned aerial vehicles (UAVs) can be utilized as aerial base stations (ABSs) to assist terrestrial infrastructure for keeping wireless connectivity in various emergency scenarios. To maximize the coverage rate of N ground users (GUs) by…

Information Theory · Computer Science 2020-02-06 Jin Qiu , Jiangbin Lyu , Liqun Fu