English
Related papers

Related papers: Target-Following Double Deep Q-Networks for UAVs

200 papers

Directional antenna systems are gaining substantial traction for aerial networks due to their higher gain, extended transmission range, and enhanced security. However, the requirement of beam alignment makes the task of finding and reaching…

Networking and Internet Architecture · Computer Science 2026-05-14 Md Asif Ishrak Sarder , Murat Yuksel , Elizabeth Bentley

Target tracking is an important issue of social security. In order to track a target, traditionally a large amount of surveillance video data need to be uploaded into the cloud for processing and analysis, which put stremendous bandwidth…

Signal Processing · Electrical Eng. & Systems 2019-02-05 Yajun Liu , Congxu Zhu , Xiaoheng Deng , Peiyuan Guan , Zhiwen Wan , Jie Luo , Enlu Liu , Honggang Zhang

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Hongji Huang , Yuchun Yang , Hong Wang , Zhiguo Ding , Hikmet Sari , Fumiyuki Adachi

In this letter, we study the energy efficiency (EE) optimisation of unmanned aerial vehicles (UAVs) providing wireless coverage to static and mobile ground users. Recent multi-agent reinforcement learning approaches optimise the system's EE…

Networking and Internet Architecture · Computer Science 2022-04-05 Babatunji Omoniwa , Boris Galkin , Ivana Dusparic

This paper presents a Double Deep Q-Network algorithm for trading single assets, namely the E-mini S&P 500 continuous futures contract. We use a proven setup as the foundation for our environment with multiple extensions. The features of…

Machine Learning · Computer Science 2022-06-30 Frensi Zejnullahu , Maurice Moser , Joerg Osterrieder

Inspired by Double Q-learning algorithm, the Double-DQN (DDQN) algorithm was originally proposed in order to address the overestimation issue in the original DQN algorithm. The DDQN has successfully shown both theoretically and empirically…

Artificial Intelligence · Computer Science 2024-10-30 Shervin Halat , Mohammad Mehdi Ebadzadeh , Kiana Amani

This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be…

Robotics · Computer Science 2019-05-28 Andriy Sarabakha , Erdal Kayacan

Unmanned Aerial Vehicles (UAVs) are increasingly used as aerial base stations to provide ad hoc communications infrastructure. Building upon prior research efforts which consider either static nodes, 2D trajectories or single UAV systems,…

Multiagent Systems · Computer Science 2023-12-20 Danish Rizvi , David Boyle

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

This paper introduces Q-learning with gradient target tracking, a novel reinforcement learning framework that provides a learned continuous target update mechanism as an alternative to the conventional hard update paradigm. In the standard…

Machine Learning · Computer Science 2025-07-21 Bum Geun Park , Taeho Lee , Donghwan Lee

Financial market prediction and optimal trading strategy development remain challenging due to market complexity and volatility. Our research in quantum finance and reinforcement learning for decision-making demonstrates the approach of…

Quantum Physics · Physics 2025-01-24 Siddhant Dutta , Nouhaila Innan , Alberto Marchisio , Sadok Ben Yahia , Muhammad Shafique

This paper presents a deep Q-network (DQN)-based gain-scheduling framework for safety-critical quadcopter trajectory tracking. Instead of directly learning control inputs, the proposed approach selects from a finite set of pre-certified…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hossein Rastgoftar , Muhammad J. H. Zahed

Unmanned Aerial Vehicles (UAV) can pose a major risk for aviation safety, due to both negligent and malicious use. For this reason, the automated detection and tracking of UAV is a fundamental task in aerial security systems. Common…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Brian K. S. Isaac-Medina , Matt Poyser , Daniel Organisciak , Chris G. Willcocks , Toby P. Breckon , Hubert P. H. Shum

We solve active target tracking, one of the essential tasks in autonomous systems, using a deep reinforcement learning (RL) approach. In this problem, an autonomous agent is tasked with acquiring information about targets of interests using…

Machine Learning · Computer Science 2020-06-19 Heejin Jeong , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

For the purpose of inspecting power plants, autonomous robots can be built using reinforcement learning techniques. The method replicates the environment and employs a simple reinforcement learning (RL) algorithm. This strategy might be…

Robotics · Computer Science 2023-03-17 Haoran Guan

Decision making for autonomous driving in urban environments is challenging due to the complexity of the road structure and the uncertainty in the behavior of diverse road users. Traditional methods consist of manually designed rules as the…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Niranjan Deshpande , Dominique Vaufreydaz , Anne Spalanzani

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

We apply Deep Q-network (DQN) with the consideration of safety during the task for deciding whether to conduct the maneuver. Furthermore, we design two similar Deep Q learning frameworks with quadratic approximator for deciding how to…

Robotics · Computer Science 2019-07-31 Tianyu Shi , Pin Wang , Xuxin Cheng , Ching-Yao Chan , Ding Huang