English
Related papers

Related papers: VesNet-RL: Simulation-based Reinforcement Learning…

200 papers

Aligning a lens system relative to an imager is a critical challenge in camera manufacturing. While optimal alignment can be mathematically computed under ideal conditions, real-world deviations caused by manufacturing tolerances often…

Robotics · Computer Science 2025-10-06 Matthias Burkhardt , Tobias Schmähling , Pascal Stegmann , Michael Layh , Tobias Windisch

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack…

Robotics · Computer Science 2019-08-30 Ayzaan Wahid , Alexander Toshev , Marek Fiser , Tsang-Wei Edward Lee

Reinforcement learning (RL) has been a promising essence in future 5G-beyond and 6G systems. Its main advantage lies in its robust model-free decision-making in complex and large-dimension wireless environments. However, most existing RL…

Robotics · Computer Science 2025-02-04 Eslam Eldeeb , Hirley Alves

The utilisation of deep learning segmentation algorithms that learn complex organs and tissue patterns and extract essential regions of interest from the noisy background to improve the visual ability for medical image diagnosis has…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yanming Guo

Deep reinforcement learning has emerged as a promising and powerful technique for automatically acquiring control policies that can process raw sensory inputs, such as images, and perform complex behaviors. However, extending deep RL to…

Machine Learning · Computer Science 2017-06-09 Fereshteh Sadeghi , Sergey Levine

Transesophageal echocardiography (TEE) plays a pivotal role in cardiology for diagnostic and interventional procedures. However, using it effectively requires extensive training due to the intricate nature of image acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Abdoul Aziz Amadou , Vivek Singh , Florin C. Ghesu , Young-Ho Kim , Laura Stanciulescu , Harshitha P. Sai , Puneet Sharma , Alistair Young , Ronak Rajani , Kawal Rhode

The proliferation of unmanned aerial vehicles (UAVs) in controlled airspace presents significant risks, including potential collisions, disruptions to air traffic, and security threats. Ensuring the safe and efficient operation of airspace,…

Robotics · Computer Science 2025-10-22 Francisco Giral , Ignacio Gómez , Soledad Le Clainche

In Ultrasound Localization Microscopy (ULM), achieving high-resolution images relies on the precise localization of contrast agent particles across a series of beamformed frames. However, our study uncovers an enormous potential: The…

Computational Geometry · Computer Science 2024-04-09 Christopher Hahne , Georges Chabouh , Arthur Chavignon , Olivier Couture , Raphael Sznitman

This paper presents a deep learning approach to aid dead-reckoning (DR) navigation using a limited sensor suite. A Recurrent Neural Network (RNN) was developed to predict the relative horizontal velocities of an Autonomous Underwater…

Robotics · Computer Science 2021-10-05 Ivar Bjørgo Saksvik , Alex Alcocer , Vahid Hassani

Autonomous robots must navigate and operate in diverse environments, from terrestrial and aquatic settings to aerial and space domains. While Reinforcement Learning (RL) has shown promise in training policies for specific autonomous robots,…

Magnetic micro-robots have demonstrated immense potential in biomedical applications, such as in vivo drug delivery, non-invasive diagnostics, and cell-based therapies, owing to their precise maneuverability and small size. However, current…

Robotics · Computer Science 2025-03-11 Yudong Mao , Dandan Zhang

Reinforcement Learning is a mature technology, often suggested as a potential route towards Artificial General Intelligence, with the ambitious goal of replicating the wide range of abilities found in natural and artificial intelligence,…

Machine Learning · Computer Science 2025-11-25 Markus D. Solbach , John K. Tsotsos

Ultrasound is widely employed for clinical intervention and diagnosis, due to its advantages of offering non-invasive, radiation-free, and real-time imaging. However, the accessibility of this dexterous procedure is limited due to the…

Robotics · Computer Science 2024-09-24 Deepak Raina , Mythra V. Balakuntala , Byung Wook Kim , Juan Wachs , Richard Voyles

This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from traditional RL…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Yimian Ding , Jingzehua Xu , Guanwen Xie , Shuai Zhang , Yi Li

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Deep reinforcement learning (DRL) demonstrates great potential in mapless navigation domain. However, such a navigation model is normally restricted to a fixed configuration of the range sensor because its input format is fixed. In this…

Robotics · Computer Science 2021-03-12 Wei Zhang , Ning Liu , Yunfeng Zhang

Reinforcement learning can enable robots to navigate to distant goals while optimizing user-specified reward functions, including preferences for following lanes, staying on paved paths, or avoiding freshly mowed grass. However, online…

Robotics · Computer Science 2022-12-19 Dhruv Shah , Arjun Bhorkar , Hrish Leen , Ilya Kostrikov , Nick Rhinehart , Sergey Levine

Autonomous navigation is crucial for both medical and industrial endoscopic robots, enabling safe and efficient exploration of narrow tubular environments without continuous human intervention, where avoiding contact with the inner walls…

Robotics · Computer Science 2026-01-07 Sicong Gao , Chen Qian , Laurence Xian , Liao Wu , Maurice Pagnucco , Yang Song

The use of reinforcement learning (RL) in scientific applications, such as materials design and automated chemistry, is increasing. A major challenge, however, lies in fact that measuring the state of the system is often costly and time…

Machine Learning · Computer Science 2022-04-08 Colin Bellinger , Andriy Drozdyuk , Mark Crowley , Isaac Tamblyn