English
Related papers

Related papers: Autonomous Path Planning for Intercostal Robotic U…

200 papers

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health…

Machine Learning · Statistics 2025-04-21 Chengchun Shi

Extrinsic calibration is essential for multi-sensor fusion, existing methods rely on structured targets or fully-excited data, limiting real-world applicability. Online calibration further suffers from weak excitation, leading to unreliable…

Robotics · Computer Science 2025-08-11 Baorun Li , Chengrui Zhu , Siyi Du , Bingran Chen , Jie Ren , Wenfei Wang , Yong Liu , Jiajun Lv

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

We present a case for the use of Reinforcement Learning (RL) for the design of physics instrument as an alternative to gradient-based instrument-optimization methods. It's applicability is demonstrated using two empirical studies. One is…

Instrumentation and Detectors · Physics 2024-12-16 Shah Rukh Qasim , Patrick Owen , Nicola Serra

We present a generic Reinforcement Learning (RL) framework optimized for crafting adversarial attacks on different model types spanning from ECG signal analysis (1D), image classification (2D), and video classification (3D). The framework…

Machine Learning · Computer Science 2024-04-23 Soumyendu Sarkar , Ashwin Ramesh Babu , Sajad Mousavi , Vineet Gundecha , Avisek Naug , Sahand Ghorbanpour

3D ultrasound (US) is widely used for its rich diagnostic information. However, it is criticized for its limited field of view. 3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Mingyuan Luo , Xin Yang , Xiaoqiong Huang , Yuhao Huang , Yuxin Zou , Xindi Hu , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

In this work, we present a learning-based approach to analysis cyberspace configuration. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater…

Artificial Intelligence · Computer Science 2020-07-10 Lei Zhang , Wei Bai , Shize Guo , Shiming Xia , Hongmei Li , Zhisong Pan

Spinal fusion surgery requires highly accurate implantation of pedicle screw implants, which must be conducted in critical proximity to vital structures with a limited view of anatomy. Robotic surgery systems have been proposed to improve…

Many healthcare decisions involve navigating through a multitude of treatment options in a sequential and iterative manner to find an optimal treatment pathway with the goal of an optimal patient outcome. Such optimization problems may be…

Machine Learning · Computer Science 2021-03-10 Elsa Riachi , Muhammad Mamdani , Michael Fralick , Frank Rudzicz

Indoor autonomous navigation requires a precise and accurate localization system able to guide robots through cluttered, unstructured and dynamic environments. Ultra-wideband (UWB) technology, as an indoor positioning system, offers precise…

Robotics · Computer Science 2021-12-21 Enrico Sutera , Vittorio Mazzia , Francesco Salvetti , Giovanni Fantin , Marcello Chiaberge

The area of Neurosymbolic Artificial Intelligence (Neurosymbolic AI) is rapidly developing and has become a popular research topic, encompassing sub-fields such as Neurosymbolic Deep Learning (Neurosymbolic DL) and Neurosymbolic…

Artificial Intelligence · Computer Science 2023-09-06 K. Acharya , W. Raza , C. M. J. M. Dourado , A. Velasquez , H. Song

We introduce a reinforcement learning (RL) based adaptive optimization algorithm for aerodynamic shape optimization focused on dimensionality reduction. The form in which RL is applied here is that of a surrogate-based, actor-critic policy…

This paper investigates the application of reinforcement learning (RL) to multi-robot social formation navigation, a critical capability for enabling seamless human-robot coexistence. While RL offers a promising paradigm, the inherent…

Robotics · Computer Science 2025-12-17 Hao Fu , Wei Liu , Shuai Zhou

Purpose: In high-dose-rate (HDR) prostate brachytherapy procedures, the pattern of needle placement solely relies on physician experience. We investigated the feasibility of using reinforcement learning (RL) to provide needle positions and…

Medical Physics · Physics 2025-06-12 Tonghe Wang , Yining Feng , Xiaofeng Yang

Automatic and accurate detection of anatomical landmarks is an essential operation in medical image analysis with a multitude of applications. Recent deep learning methods have improved results by directly encoding the appearance of the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guang-Quan Zhou , Juzheng Miao , Xin Yang , Rui Li , En-Ze Huo , Wenlong Shi , Yuhao Huang , Jikuan Qian , Chaoyu Chen , Dong Ni

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data through implicit…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Amirali Molaei , Amirhossein Aminimehr , Armin Tavakoli , Amirhossein Kazerouni , Bobby Azad , Reza Azad , Dorit Merhof

In this paper, we present a simple framework of skill transfer learning for robotic ultrasound-guidance procedures. We briefly review challenges in skill transfer learning for robotic ultrasound-guidance procedures. We then identify the…

Robotics · Computer Science 2023-05-09 Tsz Yan Leung , Miguel Xochicale

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

This paper investigates the use of Reinforcement Learning for the robust design of low-thrust interplanetary trajectories in presence of severe disturbances, modeled alternatively as Gaussian additive process noise, observation noise,…

Machine Learning · Computer Science 2020-08-20 Alessandro Zavoli , Lorenzo Federici