English
Related papers

Related papers: GRaD-Nav: Efficiently Learning Visual Drone Naviga…

200 papers

Modern autonomous navigation systems predominantly rely on lidar and depth cameras. However, a fundamental question remains: Can flying robots navigate in clutter using solely monocular RGB images? Given the prohibitive costs of real-world…

Robotics · Computer Science 2025-12-22 Xijie Huang , Jinhan Li , Tianyue Wu , Xin Zhou , Zhichao Han , Fei Gao

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots. Recent deep reinforcement learning approaches show promising results to solve the problem, but it is not solved yet, as they typically…

Robotics · Computer Science 2022-10-21 Diego Martinez , Luis Riazuelo , Luis Montano

The advancement in autonomous vehicles has empowered navigation and exploration in unknown environments. Geomagnetic navigation for autonomous vehicles has drawn increasing attention with its independence from GPS or inertial navigation…

Robotics · Computer Science 2025-02-10 Wenqi Bai , Shiliang Zhang , Xiaohui Zhang , Xuehui Ma , Songnan Yang , Yushuai Li , Tingwen Huang

The sample inefficiency of reinforcement learning (RL) remains a significant challenge in robotics. RL requires large-scale simulation and can still cause long training times, slowing research and innovation. This issue is particularly…

Robotics · Computer Science 2026-01-16 Johannes Heeg , Yunlong Song , Davide Scaramuzza

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

The development of a reliable subgrid-scale (SGS) model for large-eddy simulation (LES) is of great importance for many scientific and engineering applications. Recently, deep learning approaches have been tested for this purpose using…

Fluid Dynamics · Physics 2022-11-09 Junhyuk Kim , Hyojin Kim , Jiyeon Kim , Changhoon Lee

In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Christos Maikos , Georgios Angelidis , Georgios Th. Papadopoulos

In this paper, we study the application of DRL algorithms in the context of local navigation problems, in which a robot moves towards a goal location in unknown and cluttered workspaces equipped only with limited-range exteroceptive…

Robotics · Computer Science 2025-06-17 Victor R. F. Miranda , Armando A. Neto , Gustavo M. Freitas , Leonardo A. Mozelli

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Unmanned aerial vehicles (UAVs) are playing an increasingly pivotal role in modern communication networks,offering flexibility and enhanced coverage for a variety of applica-tions. However, UAV networks pose significant challenges due to…

Networking and Internet Architecture · Computer Science 2025-02-19 Wei Zhao , Shaoxin Cui , Wen Qiu , Zhiqiang He , Zhi Liu , Xiao Zheng , Bomin Mao , Nei Kato

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

Autonomous drone racing has attracted increasing interest as a research topic for exploring the limits of agile flight. However, existing studies primarily focus on obstacle-free racetracks, while the perception and dynamic challenges…

Robotics · Computer Science 2026-03-02 Fangyu Sun , Fanxing Li , Yu Hu , Linzuo Zhang , Yueqian Liu , Wenxian Yu , Danping Zou

Mobile robot navigation in dynamic environments with pedestrian traffic is a key challenge in the development of autonomous mobile service robots. Recently, deep reinforcement learning-based methods have been actively studied and have…

Robotics · Computer Science 2026-05-19 Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

This work presents a study on parallel and distributional deep reinforcement learning applied to the mapless navigation of UAVs. For this, we developed an approach based on the Soft Actor-Critic method, producing a distributed and…

In this paper, the problem of the trajectory design for a group of energy-constrained drones operating in dynamic wireless network environments is studied. In the considered model, a team of drone base stations (DBSs) is dispatched to…

Machine Learning · Computer Science 2020-12-08 Ye Hu , Mingzhe Chen , Walid Saad , H. Vincent Poor , Shuguang Cui

An excellent representation is crucial for reinforcement learning (RL) performance, especially in vision-based reinforcement learning tasks. The quality of the environment representation directly influences the achievement of the learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jiaxu Wang , Qiang Zhang , Jingkai Sun , Jiahang Cao , Gang Han , Wen Zhao , Weining Zhang , Yecheng Shao , Yijie Guo , Renjing Xu

Cellular-connected unmanned aerial vehicle (UAV) is a promising technology to unlock the full potential of UAVs in the future. However, how to achieve ubiquitous three-dimensional (3D) communication coverage for the UAVs in the sky is a new…

Signal Processing · Electrical Eng. & Systems 2020-03-18 Yong Zeng , Xiaoli Xu , Shi Jin , Rui Zhang

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Model-free Deep Reinforcement Learning (DRL) controllers have demonstrated promising results on various challenging non-linear control tasks. While a model-free DRL algorithm can solve unknown dynamics and high-dimensional problems, it…

Robotics · Computer Science 2022-03-03 Zikang Xiong , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan