English
Related papers

Related papers: UAV Target Tracking in Urban Environments Using De…

200 papers

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Unmanned Aerial Vehicles (UAVs), autonomously-guided aircraft, are widely used for tasks involving surveillance and reconnaissance. A version of the pursuit-evasion problems centered around UAVs and its variants has been extensively studied…

Robotics · Computer Science 2019-11-06 Loren Anderson , Sahitya Senapathy

To accomplish various tasks, safe and smooth control of unmanned aerial vehicles (UAVs) needs to be guaranteed, which cannot be met by existing ultra-reliable low latency communications (URLLC). This has attracted the attention of the…

Systems and Control · Electrical Eng. & Systems 2024-08-09 Wenchao Wu , Yanning Wu , Yuanqing Yang , Yansha Deng

This paper presents a deep Q-network (DQN)-based gain-scheduling framework for safety-critical quadcopter trajectory tracking. Instead of directly learning control inputs, the proposed approach selects from a finite set of pre-certified…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hossein Rastgoftar , Muhammad J. H. Zahed

Unmanned aerial vehicles (UAV) are commonly used for missions in unknown environments, where an exact mathematical model of the environment may not be available. This paper provides a framework for using reinforcement learning to allow the…

Robotics · Computer Science 2018-01-17 Huy X. Pham , Hung M. La , David Feil-Seifer , Luan V. Nguyen

This research project presents the implementation of a Deep Q-Learning Network (DQN) for a self-driving car on a 2-dimensional (2D) custom track, with the objective of enhancing the DQN network's performance. It encompasses the development…

Artificial Intelligence · Computer Science 2026-04-17 Sagar Pathak , Bidhya Shrestha

Collaborative heterogeneous robot systems can greatly improve the efficiency of target search and navigation tasks. In this paper, we design a heterogeneous robot system consisting of a UAV and a UGV for search and rescue missions in…

Robotics · Computer Science 2024-05-21 Yun Chen , Jiaping Xiao

This paper introduces a challenging object grasping task and proposes a self-supervised learning approach. The goal of the task is to grasp an object which is not feasible with a single parallel gripper, but only with harnessing environment…

Robotics · Computer Science 2021-04-06 Hengyue Liang , Xibai Lou , Yang Yang , Changhyun Choi

The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science…

Robotics · Computer Science 2024-02-02 Raul Fernandez-Fernandez , Juan G. Victores , Carlos Balaguer

Vehicle tracking has become one of the key applications of wireless sensor networks (WSNs) in the fields of rescue, surveillance, traffic monitoring, etc. However, the increased tracking accuracy requires more energy consumption. In this…

Systems and Control · Electrical Eng. & Systems 2020-02-25 Jun Li , Zhichao Xing , Weibin Zhang , Yan Lin , Feng Shu

Pursuit-evasion is the problem of capturing mobile targets with one or more pursuers. We use deep reinforcement learning for pursuing an omni-directional target with multiple, homogeneous agents that are subject to unicycle kinematic…

Multiagent Systems · Computer Science 2021-08-10 Cristino de Souza , Rhys Newbury , Akansel Cosgun , Pedro Castillo , Boris Vidolov , Dana Kulic

This paper introduces a machine learning based system for controlling a robotic manipulator with visual perception only. The capability to autonomously learn robot controllers solely from raw-pixel images and without any prior knowledge of…

Machine Learning · Computer Science 2015-11-16 Fangyi Zhang , Jürgen Leitner , Michael Milford , Ben Upcroft , Peter Corke

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots. Recent deep reinforcement learning approaches show promising results to solve the problem, but it is not solved yet, as they typically…

Robotics · Computer Science 2022-10-21 Diego Martinez , Luis Riazuelo , Luis Montano

Target tracking is an important issue of social security. In order to track a target, traditionally a large amount of surveillance video data need to be uploaded into the cloud for processing and analysis, which put stremendous bandwidth…

Signal Processing · Electrical Eng. & Systems 2019-02-05 Yajun Liu , Congxu Zhu , Xiaoheng Deng , Peiyuan Guan , Zhiwen Wan , Jie Luo , Enlu Liu , Honggang Zhang

The proliferation of unmanned aerial vehicles (UAVs) in controlled airspace presents significant risks, including potential collisions, disruptions to air traffic, and security threats. Ensuring the safe and efficient operation of airspace,…

Robotics · Computer Science 2025-10-22 Francisco Giral , Ignacio Gómez , Soledad Le Clainche

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

Path planning methods for autonomous unmanned aerial vehicles (UAVs) are typically designed for one specific type of mission. This work presents a method for autonomous UAV path planning based on deep reinforcement learning (DRL) that can…

Robotics · Computer Science 2022-02-07 Mirco Theile , Harald Bayerlein , Richard Nai , David Gesbert , Marco Caccamo

One of the crucial problems in robotic swarm-based operation is to search and neutralize heterogeneous targets in an unknown and uncertain environment, without any communication within the swarm. Here, some targets can be neutralized by a…

Multiagent Systems · Computer Science 2020-11-16 Nishant Mohanty , Mohitvishnu S. Gadde , Suresh Sundaram , Narasimhan Sundararajan , P. B. Sujit

Drones equipped with overhead manipulators offer unique capabilities for inspection, maintenance, and contact-based interaction. However, the motion of the drone and its manipulator is tightly linked, and even small attitude changes caused…

Robotics · Computer Science 2026-03-30 Hazim Alzorgan , Sayed Pedram Haeri Boroujeni , Abolfazl Razi

Autonomous driving is a challenging domain that entails multiple aspects: a vehicle should be able to drive to its destination as fast as possible while avoiding collision, obeying traffic rules and ensuring the comfort of passengers. In…

Machine Learning · Computer Science 2019-02-28 Changjian Li , Krzysztof Czarnecki