English
Related papers

Related papers: Coaching a Robotic Sonographer: Learning Robotic U…

200 papers

Robot-guided catheter insertion has the potential to deliver urgent medical care in situations where medical personnel are unavailable. However, this technique requires accurate and reliable segmentation of anatomical landmarks in the body.…

Image and Video Processing · Electrical Eng. & Systems 2023-01-19 Cecilia Morales , Jason Yao , Tejas Rane , Robert Edman , Howie Choset , Artur Dubrawski

Medical Ultrasound (US) imaging has seen increasing demands over the past years, becoming one of the most preferred imaging modalities in clinical practice due to its affordability, portability, and real-time capabilities. However, it faces…

Real-time tracking of dynamic targets amidst large-scale, high-frequency disturbances remains a critical unsolved challenge in Robotic Ultrasound Systems (RUSS), primarily due to the end-to-end latency of existing systems. This paper argues…

Robotics · Computer Science 2025-11-04 Yizhao Qian , Yujie Zhu , Jiayuan Luo , Li Liu , Yixuan Yuan , Guochen Ning , Hongen Liao

In medical imaging, manual annotations can be expensive to acquire and sometimes infeasible to access, making conventional deep learning-based models difficult to scale. As a result, it would be beneficial if useful representations could be…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Jianbo Jiao , Yifan Cai , Mohammad Alsharid , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Assistive robots for healthcare have seen a growing demand due to the great potential of relieving medical practitioners from routine jobs. In this paper, we investigate the development of an optimization-based control framework for an…

Robotics · Computer Science 2022-03-07 Anqing Duan , Maria Victorova , Jingyuan Zhao , Yongping Zheng , David Navarro-Alarcon

Ultrasound (US) is one of the most common medical imaging modalities since it is radiation-free, low-cost, and real-time. In freehand US examinations, sonographers often navigate a US probe to visualize standard examination planes with rich…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Yuan Bi , Zhongliang Jiang , Yuan Gao , Thomas Wendler , Angelos Karlas , Nassir Navab

In this paper we introduce the first reinforcement learning (RL) based robotic navigation method which utilizes ultrasound (US) images as an input. Our approach combines state-of-the-art RL techniques, specifically deep Q-networks (DQN)…

Learning from Demonstration (LfD) seeks to democratize robotics by enabling non-roboticist end-users to teach robots to perform novel tasks by providing demonstrations. However, as demonstrators are typically non-experts, modern LfD…

Robotics · Computer Science 2021-10-12 Letian Chen , Rohan Paleja , Matthew Gombolay

A command-following robot that serves people in everyday life must continually improve itself in deployment domains with minimal help from its end users, instead of engineers. Previous methods are either difficult to continuously improve…

Over the last decade, the use of machine learning (ML) approaches in medicinal applications has increased manifold. Most of these approaches are based on deep learning, which aims to learn representations from grid data (like medical…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Maha Ezzelarab , Midhila Madhusoodanan , Shrimanti Ghosh , Geetika Vadali , Jacob Jaremko , Abhilash Hareendranathan

Despite renewed awareness of the importance of articulation, it remains a challenge for instructors to handle the pronunciation needs of language learners. There are relatively scarce pedagogical tools for pronunciation teaching and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 M. Hamed Mozaffari , Won-Sook Lee

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Deep reinforcement learning (DRL) agents are trained through trial-and-error interactions with the environment. This leads to a long training time for dense neural networks to achieve good performance. Hence, prohibitive computation and…

Machine Learning · Computer Science 2022-05-09 Ghada Sokar , Elena Mocanu , Decebal Constantin Mocanu , Mykola Pechenizkiy , Peter Stone

Learning to produce contact-rich, dynamic behaviors from raw sensory data has been a longstanding challenge in robotics. Prominent approaches primarily focus on using visual or tactile sensing, where unfortunately one fails to capture…

Robotics · Computer Science 2022-10-04 Abitha Thankaraj , Lerrel Pinto

Preference-based reinforcement learning (RL) has shown potential for teaching agents to perform the target tasks without a costly, pre-defined reward function by learning the reward with a supervisor's preference between the two agent…

Machine Learning · Computer Science 2022-03-21 Jongjin Park , Younggyo Seo , Jinwoo Shin , Honglak Lee , Pieter Abbeel , Kimin Lee

Robotic ultrasound offers advantages over free-hand scanning, including improved reproducibility and reduced operator dependency. In clinical practice, US acquisition relies heavily on the sonographer's experience and situational judgment.…

Robotics · Computer Science 2026-03-17 Yuan Bi , Yiping Zhou , Pei Liu , Feng Li , Zhongliang Jiang , Nassir Navab

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

Ultrasound simulation based on ray tracing enables the synthesis of highly realistic images. It can provide an interactive environment for training sonographers as an educational tool. However, due to high computational demand, there is a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Lin Zhang , Tiziano Portenier , Christoph Paulus , Orcun Goksel