English
Related papers

Related papers: Navigation in a simplified Urban Flow through Deep…

200 papers

Cellular-connected unmanned aerial vehicle (UAV) is a promising technology to unlock the full potential of UAVs in the future. However, how to achieve ubiquitous three-dimensional (3D) communication coverage for the UAVs in the sky is a new…

Signal Processing · Electrical Eng. & Systems 2020-03-18 Yong Zeng , Xiaoli Xu , Shi Jin , Rui Zhang

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

For real-world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with…

Robotics · Computer Science 2021-04-16 Yuanyang Zhu , Zhi Wang , Chunlin Chen , Daoyi Dong

In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments,…

Multiagent Systems · Computer Science 2023-09-06 Zhengrong Song , Chuan Ma , Ming Ding , Howard H. Yang , Yuwen Qian , Xiangwei Zhou

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

The rapid advancement of electric vertical takeoff and landing (eVTOL) aircraft offers a promising opportunity to alleviate urban traffic congestion but is still limited by excessive power demands, especially during the takeoff phase. Thus,…

Machine Learning · Computer Science 2026-05-06 Nathan M. Roberts , Xiaosong Du

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

Human error is a substantial factor in marine accidents, accounting for 85% of all reported incidents. By reducing the need for human intervention in vessel navigation, AI-based methods can potentially reduce the risk of accidents. AI…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Joel Jose , Md Shadab Alam , Abhilash Sharma Somayajula

Vessel navigation is difficult in restricted waterways and in the presence of static and dynamic obstacles. This difficulty can be attributed to the high-level decisions taken by humans during these maneuvers, which is evident from the fact…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Sanjeev Kumar Ramkumar Sudha , Md Shadab Alam , Bindusara Reddy , Abhilash Sharma Somayajula

Local navigation in cluttered environments often suffers from dense obstacles and frequent local minima. Conventional local planners rely on heuristics and are prone to failure, while deep reinforcement learning(DRL)based approaches provide…

Robotics · Computer Science 2026-03-18 Jiwon Park , Dongkyu Lee , I Made Aswin Nahrendra , Jaeyoung Lim , Hyun Myung

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Unmanned Aerial Vehicles (UAVs) are increasingly used in automated inspection, delivery, and navigation tasks that require reliable autonomy. This project develops a reinforcement learning (RL) approach to enable a single UAV to…

Robotics · Computer Science 2025-09-18 Salim Oyinlola , Nitesh Subedi , Soumik Sarkar

Deep Reinforcement Learning (DRL) emerges as a prime solution for Unmanned Aerial Vehicle (UAV) trajectory planning, offering proficiency in navigating high-dimensional spaces, adaptability to dynamic environments, and making sequential…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Chenrui Sun , Gianluca Fontanesi , Swarna Bindu Chetty , Xuanyu Liang , Berk Canberk , Hamed Ahmadi

Zermelo's navigation problem seeks the trajectory of minimal travel time between two points in a fluid flow. We address this problem for an agent -- such as a micro-robot or active particle -- that is advected by a two-dimensional flow,…

Fluid Dynamics · Physics 2025-12-29 Vladimir Parfenyev

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain…

Robotics · Computer Science 2023-04-13 Xuyang Li , Jianwu Fang , Kai Du , Kuizhi Mei , Jianru Xue

We present a novel algorithm (DeepMNavigate) for global multi-agent navigation in dense scenarios using deep reinforcement learning (DRL). Our approach uses local and global information for each robot from motion information maps. We use a…

Multiagent Systems · Computer Science 2020-07-30 Qingyang Tan , Tingxiang Fan , Jia Pan , Dinesh Manocha

Autonomous navigation in unstructured environments is essential for field and planetary robotics, where robots must efficiently reach goals while avoiding obstacles under uncertain conditions. Conventional algorithmic approaches often…

Robotics · Computer Science 2025-10-28 Shreya Santra , Thomas Robbins , Kazuya Yoshida

Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight…

Robotics · Computer Science 2024-12-25 Kangtong Mo , Linyue Chu , Xingyu Zhang , Xiran Su , Yang Qian , Yining Ou , Wian Pretorius

Traffic scenarios in roundabouts pose substantial complexity for automated driving. Manually mapping all possible scenarios into a state space is labor-intensive and challenging. Deep reinforcement learning (DRL) with its ability to learn…

Robotics · Computer Science 2023-06-21 Henan Yuan , Penghui Li , Bart van Arem , Liujiang Kang , Yongqi Dong

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold