English
Related papers

Related papers: Target-Following Double Deep Q-Networks for UAVs

200 papers

Considering the user mobility and unpredictable mobile edge computing (MEC) environments, this paper studies the intelligent task offloading problem in unmanned aerial vehicle (UAV)-enabled MEC with the assistance of digital twin (DT). We…

Information Theory · Computer Science 2022-08-02 Bin Li , Yufeng Liu , Ling Tan , Heng Pan , Yan Zhang

This paper investigates the problem of traffic surveillance using an unmanned aerial vehicle (UAV) and proposes a domain-knowledge-aided airborne ground moving targets tracking algorithm. To improve the accuracy of multiple targets…

Signal Processing · Electrical Eng. & Systems 2023-03-14 Jianduo Chai , Shaoming He , Hyo-Sang Shin

This paper presents a hierarchical path-planning and control framework that combines a high-level Deep Q-Network (DQN) for discrete sub-goal selection with a low-level Twin Delayed Deep Deterministic Policy Gradient (TD3) controller for…

Robotics · Computer Science 2025-10-31 Xiaoyi He , Danggui Chen , Zhenshuo Zhang , Zimeng Bai

The deep Q-network (DQN) and return-based reinforcement learning are two promising algorithms proposed in recent years. DQN brings advances to complex sequential decision problems, while return-based algorithms have advantages in making use…

Machine Learning · Computer Science 2019-12-02 Wenjia Meng , Qian Zheng , Long Yang , Pengfei Li , Gang Pan

Multi-robot target tracking finds extensive applications in different scenarios, such as environmental surveillance and wildfire management, which require the robustness of the practical deployment of multi-robot systems in uncertain and…

Robotics · Computer Science 2024-12-18 Jiazhen Liu , Peihan Li , Yuwei Wu , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou

Autonomous driving is a promising technology to reduce traffic accidents and improve driving efficiency. In this work, a deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Jiangdong Liao , Teng Liu , Xiaolin Tang , Xingyu Mu , Bing Huang , Dongpu Cao

The unmanned aerial vehicle (UAV) is one of the technological breakthroughs that supports a variety of services, including communications. UAV will play a critical role in enhancing the physical layer security of wireless networks. This…

Information Theory · Computer Science 2021-12-22 Aly Sabri Abdalla , Ali Behfarnia , Vuk Marojevic

Advanced Air Mobility (AAM) has emerged as a key pillar of next-generation transportation systems, encompassing a wide range of uncrewed aerial vehicle (UAV) applications. To enable AAM, maintaining reliable and efficient communication…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Afsoon Alidadi Shamsabadi , Cosmas Mwaba , Thomas Nugent , Jie Gao , Pablo Madoery , Halim Yanikomeroglu , Subhadeep Pal

Unmanned aerial vehicles (UAVs) have gained popularity due to their flexible mobility, on-demand deployment, and the ability to establish high probability line-of-sight wireless communication. As a result, UAVs have been extensively used as…

Systems and Control · Electrical Eng. & Systems 2023-07-06 Yunhao Quan , Nan Cheng , Xiucheng Wang , Jinglong Shen , Longfei Ma , Zhisheng Yin

Object tracking has been broadly applied in unmanned aerial vehicle (UAV) tasks in recent years. However, existing algorithms still face difficulties such as partial occlusion, clutter background, and other challenging visual factors.…

Robotics · Computer Science 2020-09-01 Yujie He , Changhong Fu , Fuling Lin , Yiming Li , Peng Lu

A tracking controller for unmanned aerial vehicles (UAVs) is developed to track moving targets undergoing unknown translational and rotational motions. The main challenges are to control both the relative positions and angles between the…

Robotics · Computer Science 2021-09-16 Hsin-Ai Hung , Hao-Huan Hsu , Teng-Hu Cheng

When tracking maneuvering targets, model-driven approaches encounter difficulties in comprehensively delineating complex real-world scenarios and are prone to model mismatch when the targets maneuver. Meanwhile, contemporary data-driven…

Signal Processing · Electrical Eng. & Systems 2024-10-21 Shuyang Zhang , Chang Gao , Qingfu Zhang , Tianyi Jia , Hongwei Liu

Aerial object tracking has broad applications in public safety, emergency rescue, wildlife monitoring, and related fields. However, existing aerial tracking benchmarks are mainly based on passive 2D video sequences captured from fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Guyue Hu , Haoming Liu , Siyuan Song , Chenglong Li , Feng Chen , Jin Tang

Owing to effective and flexible data acquisition, unmanned aerial vehicle (UAV) has recently become a hotspot across the fields of computer vision (CV) and remote sensing (RS). Inspired by recent success of deep learning (DL), many advanced…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Wu , Wei Li , Danfeng Hong , Ran Tao , Qian Du

This paper introduces a challenging object grasping task and proposes a self-supervised learning approach. The goal of the task is to grasp an object which is not feasible with a single parallel gripper, but only with harnessing environment…

Robotics · Computer Science 2021-04-06 Hengyue Liang , Xibai Lou , Yang Yang , Changhyun Choi

In reinforcement learning, it is often difficult to automate high-dimensional, rapid decision-making in dynamic environments, especially when domains require real-time online interaction and adaptive strategies such as web-based games. This…

Machine Learning · Computer Science 2024-05-30 Prabhath Reddy Gujavarthy

We present a novel Double Deep Q Network (DDQN) application to a sensor management problem in space situational awareness (SSA). Frequent launches of satellites into Earth orbit pose a significant sensor management challenge, whereby a…

Machine Learning · Computer Science 2022-05-30 Benedict Oakes , Dominic Richards , Jordi Barr , Jason F. Ralph

In this study, we present two distinct approaches within the realm of Deep Reinforcement Learning (Deep-RL) aimed at enhancing mapless navigation for a ground-based mobile robot. The research methodology primarily involves a comparative…

Drones equipped with overhead manipulators offer unique capabilities for inspection, maintenance, and contact-based interaction. However, the motion of the drone and its manipulator is tightly linked, and even small attitude changes caused…

Robotics · Computer Science 2026-03-30 Hazim Alzorgan , Sayed Pedram Haeri Boroujeni , Abolfazl Razi

In this paper, we propose an autonomous UAV path planning framework using deep reinforcement learning approach. The objective is to employ a self-trained UAV as a flying mobile unit to reach spatially distributed moving or static targets in…

Robotics · Computer Science 2020-03-25 Omar Bouhamed , Hakim Ghazzai , Hichem Besbes , Yehia Massoud