English
Related papers

Related papers: Depth-Constrained ASV Navigation with Deep RL and …

200 papers

Navigation is a critical aspect of autonomous underwater vehicles (AUVs) operating in complex underwater environments. Since global navigation satellite system (GNSS) signals are unavailable underwater, navigation relies on inertial…

Signal Processing · Electrical Eng. & Systems 2025-03-10 Rajini Makam , Nadav Cohen , Sumukh Shadakshari , Srinivasa Puranika Bhatta , Itzik Klein , Suresh Sundaram

Reinforcement learning (RL) enables social robots to generate trajectories without relying on human-designed rules or interventions, making it generally more effective than rule-based systems in adapting to complex, dynamic real-world…

Robotics · Computer Science 2025-02-07 Jianpeng Yao , Xiaopan Zhang , Yu Xia , Zejin Wang , Amit K. Roy-Chowdhury , Jiachen Li

Reinforcement Learning (RL) offers a powerful paradigm for autonomous robots to master generalist manipulation skills through trial-and-error. However, its real-world application is stifled by low sample efficiency. Recent Human-in-the-Loop…

Robotics · Computer Science 2026-03-10 Haojun Chen , Zili Zou , Chengdong Ma , Yaoxiang Pu , Haotong Zhang , Yuanpei Chen , Yaodong Yang

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the…

Autonomous Underwater Vehicles (AUVs) commonly utilize an inertial navigation system (INS) and a Doppler velocity log (DVL) for underwater navigation. To that end, their measurements are integrated through a nonlinear filter such as the…

Robotics · Computer Science 2024-09-12 Nadav Cohen , Itzik Klein

This paper proposes a novel adaptive guidance system developed using reinforcement meta-learning with a recurrent policy and value function approximator. The use of recurrent network layers allows the deployed policy to adapt real time to…

Systems and Control · Computer Science 2020-02-19 Brian Gaudet , Richard Linares , Roberto Furfaro

Autonomous driving systems (ADSs) are capable of sensing the environment and making driving decisions autonomously. These systems are safety-critical, and testing them is one of the important approaches to ensure their safety. However, due…

Software Engineering · Computer Science 2023-10-10 Chengjie Lu , Tao Yue , Man Zhang , Shaukat Ali

Autonomous Surface Vehicles (ASV) are becoming more affordable and include a wide variety of sensors and capacities with applications from ocean physics such as the Saildrone project to ecology with the tracking of marine species in the…

Signal Processing · Electrical Eng. & Systems 2024-06-28 Pierre Gogendeau , Sylvain Bonhommeau , Hassen Fourati , Mohan Julien , Matteo Contini , Thomas Chevrier , Anne Elise Nieblas , Serge Bernard

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

We introduce a multi-sensor navigation system for autonomous surface vessels (ASV) intended for water-quality monitoring in freshwater lakes. Our mission planner uses satellite imagery as a prior map, formulating offline a mission-level…

Robotics · Computer Science 2024-08-26 Philip Huang , Tony Wang , Florian Shkurti , Timothy D. Barfoot

Deep reinforcement learning (RL), where the agent learns from mistakes, has been successfully applied to a variety of tasks. With the aim of learning collision-free policies for unmanned vehicles, deep RL has been used for training with…

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Autonomous underwater vehicles (AUVs) are sophisticated robotic platforms crucial for a wide range of applications. The accuracy of AUV navigation systems is critical to their success. Inertial sensors and Doppler velocity logs (DVL) fusion…

Robotics · Computer Science 2025-12-16 Guy Damari , Itzik Klein

Monitoring and patrolling large water resources is a major challenge for conservation. The problem of acquiring data of an underlying environment that usually changes within time involves a proper formulation of the information. The use of…

Robotics · Computer Science 2022-10-18 Samuel Yanes Luis , Daniel Gutiérrez Reina , Sergio Toral Marín

Safe flight in dynamic environments requires unmanned aerial vehicles (UAVs) to make effective decisions when navigating cluttered spaces with moving obstacles. Traditional approaches often decompose decision-making into hierarchical…

Robotics · Computer Science 2025-02-25 Zhefan Xu , Xinming Han , Haoyu Shen , Hanyu Jin , Kenji Shimada

We investigate the feasibility of deploying reinforcement learning (RL) policies for constrained crowd navigation using a low-fidelity simulator. We introduce a representation of the dynamic environment, separating human and obstacle…

Robotics · Computer Science 2024-05-29 Shuijing Liu , Kaiwen Hong , Neeloy Chakraborty , Katherine Driggs-Campbell

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz