English
Related papers

Related papers: A Zero-Shot Reinforcement Learning Strategy for Au…

200 papers

We propose a method to tackle the problem of mapless collision-avoidance navigation where humans are present using 2D laser scans. Our proposed method uses ego-safety to measure collision from the robot's perspective while social-safety to…

Robotics · Computer Science 2020-11-20 Jun Jin , Nhat M. Nguyen , Nazmus Sakib , Daniel Graves , Hengshuai Yao , Martin Jagersand

We study how robots can autonomously learn skills that require a combination of navigation and grasping. While reinforcement learning in principle provides for automated robotic skill learning, in practice reinforcement learning in the real…

Machine Learning · Computer Science 2021-12-08 Charles Sun , Jędrzej Orbik , Coline Devin , Brian Yang , Abhishek Gupta , Glen Berseth , Sergey Levine

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Navigation inside luminal organs is an arduous task that requires non-intuitive coordination between the movement of the operator's hand and the information obtained from the endoscopic video. The development of tools to automate certain…

Collision-free, goal-directed navigation in environments containing unknown static and dynamic obstacles is still a great challenge, especially when manual tuning of navigation policies or costly motion prediction needs to be avoided. In…

Robotics · Computer Science 2023-03-03 Jorge de Heuvel , Weixian Shi , Xiangyu Zeng , Maren Bennewitz

We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted…

Robotics · Computer Science 2022-03-17 Honghu Xue , Benedikt Hein , Mohamed Bakr , Georg Schildbach , Bengt Abel , Elmar Rueckert

UAV navigation in unstructured outdoor environments using passive monocular vision is hindered by the substantial visual domain gap between simulation and reality. While 3D Gaussian Splatting enables photorealistic scene reconstruction from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zinan Lv , Yeqian Qian , Chen Sang , Hao Liu , Danping Zou , Ming Yang

Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and…

Robotics · Computer Science 2018-04-30 Xi Chen , Ali Ghadirzadeh , John Folkesson , Patric Jensfelt

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated data or require…

Robotics · Computer Science 2025-06-05 Arnab Debnath , Gregory J. Stein , Jana Kosecka

Dynamic coronary roadmapping is a technology that overlays the vessel maps (the "roadmap") extracted from an offline image sequence of X-ray angiography onto a live stream of X-ray fluoroscopy in real-time. It aims to offer navigational…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Yikang Liu , Lin Zhao , Eric Z. Chen , Xiao Chen , Terrence Chen , Shanhui Sun

Localizing oneself during endoscopic procedures can be problematic due to the lack of distinguishable textures and landmarks, as well as difficulties due to the endoscopic device such as a limited field of view and challenging lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Gary Sarwin , Alessandro Carretta , Victor Staartjes , Matteo Zoli , Diego Mazzatenta , Luca Regli , Carlo Serra , Ender Konukoglu

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Autonomy is a key challenge for future space exploration endeavours. Deep Reinforcement Learning holds the promises for developing agents able to learn complex behaviours simply by interacting with their environment. This paper investigates…

Robotics · Computer Science 2025-05-02 Matteo El Hariry , Andrea Cini , Giacomo Mellone , Alessandro Balossino

We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. In this work, zero-shot deformation reconstruction is defined as the ability to infer object-wide…

Robotics · Computer Science 2026-03-23 Linrui Shou , Zilang Chen , Wenjia Xu , Yiyue Luo , Tingyu Cheng

Neuroendovascular access often relies on passive microwires that are hand-shaped at the back table and then used to track a microcatheter to the target. Neuroendovascular surgeons determine the shape of the wire by examining the patient…

Robotics · Computer Science 2026-02-05 Aabha Tamhankar , Jay Patil , Giovanni Pittiglio

We present a robot navigation system that uses an imitation learning framework to successfully navigate in complex environments. Our framework takes a pre-built 3D scan of a real environment and trains an agent from pre-generated expert…

Robotics · Computer Science 2020-09-28 David Watkins-Valls , Jingxi Xu , Nicholas Waytowich , Peter Allen

This paper presents a new reward function that can be used for deep reinforcement learning in unmanned aerial vehicle (UAV) control and navigation problems. The reward function is based on the construction and estimation of the time of…

Robotics · Computer Science 2022-07-20 Mikhail S. Tovarnov , Nikita V. Bykov

In this report we present an unsupervised image registration framework, using a pre-trained deep neural network as a feature extractor. We refer this to zero-shot learning, due to nonoverlap between training and testing dataset (none of the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Avinash Kori , Ganapathi Krishnamurthi

Autonomous ultrasound (US) acquisition is an important yet challenging task, as it involves interpretation of the highly complex and variable images and their spatial relationships. In this work, we propose a deep reinforcement learning…

Robotics · Computer Science 2024-10-28 Keyu Li , Jian Wang , Yangxin Xu , Hao Qin , Dongsheng Liu , Li Liu , Max Q. -H. Meng

Controlling AUVs can be challenging because of the effect of complex non-linear hydrodynamic forces acting on the robot, which are significant in water and cannot be ignored. The problem is exacerbated for small AUVs for which the dynamics…

Robotics · Computer Science 2025-03-11 Levi Cai , Kevin Chang , Yogesh Girdhar