English
Related papers

Related papers: Dynamic Q-planning for Online UAV Path Planning in…

200 papers

Uncrewed autonomous vehicles (UAVs) have made significant contributions to reconnaissance and surveillance missions in past US military campaigns. As the prevalence of UAVs increases, there has also been improvements in counter-UAV…

Machine Learning · Computer Science 2021-12-02 Yixuan Liu , Chrysafis Vogiatzis , Ruriko Yoshida , Erich Morman

Currently decision making is one of the biggest challenges in autonomous driving. This paper introduces a method for safely navigating an autonomous vehicle in highway scenarios by combining deep Q-Networks and insight from control theory.…

Robotics · Computer Science 2023-03-23 Max Peter Ronecker , Yuan Zhu

Soft growing robots, are a type of robots that are designed to move and adapt to their environment in a similar way to how plants grow and move with potential applications where they could be used to navigate through tight spaces, dangerous…

Robotics · Computer Science 2024-01-24 Haitham El-Hussieny , Ibrahim Hameed

Path planning methods for autonomous unmanned aerial vehicles (UAVs) are typically designed for one specific type of mission. This work presents a method for autonomous UAV path planning based on deep reinforcement learning (DRL) that can…

Robotics · Computer Science 2022-02-07 Mirco Theile , Harald Bayerlein , Richard Nai , David Gesbert , Marco Caccamo

Aerial robots are increasingly being utilized for environmental monitoring and exploration. However, a key challenge is efficiently planning paths to maximize the information value of acquired data as an initially unknown environment is…

Robotics · Computer Science 2022-03-04 Julius Rückin , Liren Jin , Marija Popović

Our premise is that autonomous vehicles must optimize communications and motion planning jointly. Specifically, a vehicle must adapt its motion plan staying cognizant of communications rate related constraints and adapt the use of…

Systems and Control · Computer Science 2018-07-31 Mayank K. Pal , Rupali Bhati , Anil Sharma , Sanjit K. Kaul , Saket Anand , P. B. Sujit

For the purpose of inspecting power plants, autonomous robots can be built using reinforcement learning techniques. The method replicates the environment and employs a simple reinforcement learning (RL) algorithm. This strategy might be…

Robotics · Computer Science 2023-03-17 Haoran Guan

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

In this paper, we propose a novel deep Q-network (DQN)-based edge selection algorithm designed specifically for real-time surveillance in unmanned aerial vehicle (UAV) networks. The proposed algorithm is designed under the consideration of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Soohyun Park , Jeman Park , David Mohaisen , Joongheon Kim

Optimal motion planning involves obstacles avoidance where path planning is the key to success in optimal motion planning. Due to the computational demands, most of the path planning algorithms can not be employed for real-time based…

Robotics · Computer Science 2022-02-15 Geesara Kulathunga

Integration of reinforcement learning with unmanned aerial vehicles (UAVs) to achieve autonomous flight has been an active research area in recent years. An important part focuses on obstacle detection and avoidance for UAVs navigating…

Artificial Intelligence · Computer Science 2021-03-12 Jeremy Roghair , Kyungtae Ko , Amir Ehsan Niaraki Asli , Ali Jannesari

Dynamic optimization of nonlinear chemical systems -- such as batch reactors -- should be applied online, and the suitable control taken should be according to the current state of the system rather than the current time instant. The recent…

Systems and Control · Computer Science 2019-04-16 Abdelrahman ElMezain , Mohamed Saleh , Jie Zhang , Ahmed Soliman , Seif Fateen

In cellular-connected unmanned aerial vehicle (UAV) network, a minimization problem on the weighted sum of time cost and expected outage duration is considered. Taking advantage of UAV's adjustable mobility, an intelligent UAV navigation…

Signal Processing · Electrical Eng. & Systems 2021-09-20 Yuanjian Li , A. Hamid Aghvami , Daoyi Dong

Unmanned aerial vehicles (UAVs) have emerged as a promising auxiliary platform for smart agriculture, capable of simultaneously performing weed detection, recognition, and data collection from wireless sensors. However, trajectory planning…

Machine Learning · Computer Science 2025-12-23 Wencan Mao , Quanxi Zhou , Tomas Couso Coddou , Manabu Tsukada , Yunling Liu , Yusheng Ji

Autonomous unpowered flight is a challenge for control and guidance systems: all the energy the aircraft might use during flight has to be harvested directly from the atmosphere. We investigate the design of an algorithm that optimizes the…

Machine Learning · Computer Science 2017-07-19 Erwan Lecarpentier , Sebastian Rapp , Marc Melo , Emmanuel Rachelson

Path planning in dynamic environments is a fundamental challenge in intelligent transportation and robotics, where obstacles and conditions change over time, introducing uncertainty and requiring continuous adaptation. While existing…

Robotics · Computer Science 2025-11-20 Jonas De Maeyer , Hossein Yarahmadi , Moharram Challenger

In this paper, the trajectory optimization problem for a multi-aerial base station (ABS) communication network is investigated. The objective is to find the trajectory of the ABSs so that the sum-rate of the users served by each ABS is…

Signal Processing · Electrical Eng. & Systems 2019-07-02 Behzad Khamidehi , Elvino S. Sousa

Q-learning is a promising method for solving optimal control problems for uncertain systems without the explicit need for system identification. However, approaches for continuous-time Q-learning have limited provable safety guarantees,…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Soutrik Bandyopadhyay , Shubhendu Bhasin

Well-established optimization-based methods can guarantee an optimal trajectory for a short optimization horizon, typically no longer than a few seconds. As a result, choosing the optimal trajectory for this short horizon may still result…

Machine Learning · Computer Science 2020-12-08 Branka Mirchevska , Maria Hügle , Gabriel Kalweit , Moritz Werling , Joschka Boedecker