English
Related papers

Related papers: Navigation Through Endoluminal Channels Using Q-Le…

200 papers

We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted…

Robotics · Computer Science 2022-03-17 Honghu Xue , Benedikt Hein , Mohamed Bakr , Georg Schildbach , Bengt Abel , Elmar Rueckert

In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity…

Autonomous vehicles have the potential to revolutionize transportation, but they must be able to navigate safely in traffic before they can be deployed on public roads. The goal of this project is to train autonomous vehicles to make…

Artificial Intelligence · Computer Science 2023-11-21 Ghadi Nehme , Tejas Y. Deo

We focus on the important problem of emergency evacuation, which clearly could benefit from reinforcement learning that has been largely unaddressed. Emergency evacuation is a complex task which is difficult to solve with reinforcement…

Artificial Intelligence · Computer Science 2019-05-30 Jivitesh Sharma , Per-Arne Andersen , Ole-Chrisoffer Granmo , Morten Goodwin

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable…

This paper presents a shape-aware whole-body control framework for tendon-driven continuum robots with direct application to endoluminal surgical navigation. Endoluminal procedures, such as bronchoscopy, demand precise and safe navigation…

Robotics · Computer Science 2025-10-15 Mohammadreza Kasaei , Mostafa Ghobadi , Mohsen Khadem

This paper presents a study on the development of an obstacle-avoidance navigation system for autonomous navigation in home environments. The system utilizes vision-based techniques and advanced path-planning algorithms to enable the robot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Sagar Manglani

Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a…

Robotics · Computer Science 2025-12-12 Zamirddine Mari , Jérôme Pasquet , Julien Seinturier

Q-learning is a promising method for solving optimal control problems for uncertain systems without the explicit need for system identification. However, approaches for continuous-time Q-learning have limited provable safety guarantees,…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Soutrik Bandyopadhyay , Shubhendu Bhasin

This paper addresses the challenge of navigation in large, visually complex environments with sparse rewards. We propose a method that uses object-oriented macro actions grounded in a topological map, allowing a simple Deep Q-Network (DQN)…

Machine Learning · Computer Science 2025-04-28 Simon Hakenes , Tobias Glasmachers

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots, with recent deep reinforcement learning approaches showing promising results. However, the complexity of the real world makes it infeasible…

Robotics · Computer Science 2025-04-29 Diego Martinez-Baselga , Luis Riazuelo , Luis Montano

Purpose: Autonomous systems in mechanical thrombectomy (MT) hold promise for reducing procedure times, minimizing radiation exposure, and enhancing patient safety. However, current reinforcement learning (RL) methods only reach the carotid…

Live fire creates a dynamic, rapidly changing environment that presents a worthy challenge for deep learning and artificial intelligence methodologies to assist firefighters with scene comprehension in maintaining their situational…

Artificial Intelligence · Computer Science 2021-07-23 Manish Bhattarai , Manel Martinez-Ramon

How can a robot navigate successfully in rich and diverse environments, indoors or outdoors, along office corridors or trails on the grassland, on the flat ground or the staircase? To this end, this work aims to address three challenges:…

Robotics · Computer Science 2022-06-01 Bo Ai , Wei Gao , Vinay , David Hsu

Unmanned Surface Vehicles technology (USVs) is an exciting topic that essentially deploys an algorithm to safely and efficiently performs a mission. Although reinforcement learning is a well-known approach to modeling such a task,…

Machine Learning · Computer Science 2020-03-24 Mohammad Etemad , Nader Zare , Mahtab Sarvmaili , Amilcar Soares , Bruno Brandoli Machado , Stan Matwin

Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and…

Enabling robots to autonomously navigate complex environments is essential for real-world deployment. Prior methods approach this problem by having the robot maintain an internal map of the world, and then use a localization and planning…

Machine Learning · Computer Science 2018-05-21 Gregory Kahn , Adam Villaflor , Bosen Ding , Pieter Abbeel , Sergey Levine

We develop a deep reinforcement learning method for training a jellyfish-like swimmer to effectively track a moving target in a two-dimensional flow. This swimmer is a flexible object equipped with a muscle model based on torsional springs.…

Fluid Dynamics · Physics 2025-08-20 Yihao Chen , Yue Yang

Unmanned aerial vehicles (UAV) are commonly used for missions in unknown environments, where an exact mathematical model of the environment may not be available. This paper provides a framework for using reinforcement learning to allow the…

Robotics · Computer Science 2018-01-17 Huy X. Pham , Hung M. La , David Feil-Seifer , Luan V. Nguyen