English
Related papers

Related papers: RL-Based Guidance in Outpatient Hysteroscopy Train…

200 papers

Robotic manipulation is essential for the widespread adoption of robots in industrial and home settings and has long been a focus within the robotics community. Advances in artificial intelligence have introduced promising learning-based…

Robotics · Computer Science 2025-03-04 Kelin Li , Shubham M Wagh , Nitish Sharma , Saksham Bhadani , Wei Chen , Chang Liu , Petar Kormushev

Reinforcement learning (RL) has shown great promise with algorithms learning in environments with large state and action spaces purely from scalar reward signals. A crucial challenge for current deep RL algorithms is that they require a…

Machine Learning · Computer Science 2023-11-23 Shivakanth Sujit , Pedro H. M. Braga , Jorg Bornschein , Samira Ebrahimi Kahou

Endoluminal reconstruction using flow diverters represents a novel paradigm for the minimally invasive treatment of intracranial aneurysms. The configuration assumed by these very dense braided stents once deployed within the parent vessel…

Computational Engineering, Finance, and Science · Computer Science 2023-01-23 Beatrice Bisighini , Miquel Aguirre , Marco Evangelos Biancolini , Federica Trovalusci , David Perrin , Stephane Avril , Baptiste Pierrat

Surgical workflow analysis is essential in robot-assisted surgeries, yet the long duration of such procedures poses significant challenges for comprehensive video analysis. Recent approaches have predominantly relied on transformer models;…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Haoyang Wu , Tsun-Hsuan Wang , Mathias Lechner , Ramin Hasani , Jennifer A. Eckhoff , Paul Pak , Ozanan R. Meireles , Guy Rosman , Yutong Ban , Daniela Rus

While large models trained with self-supervised learning on offline datasets have shown remarkable capabilities in text and image domains, achieving the same generalisation for agents that act in sequential decision problems remains an open…

Machine Learning · Computer Science 2025-03-04 Michael Matthews , Michael Beukman , Chris Lu , Jakob Foerster

Exoskeletons and orthoses are wearable mobile systems providing mechanical benefits to the users. Despite significant improvements in the last decades, the technology is not fully mature to be adopted for strenuous and non-programmed tasks.…

Robotics · Computer Science 2023-03-23 Farhad Nazari , Navid Mohajer , Darius Nahavandi , Abbas Khosravi , Saeid Nahavandi

A potential Retinal Vein Occlusion (RVO) treatment involves Retinal Vein Cannulation (RVC), which requires the surgeon to insert a microneedle into the affected retinal vein and administer a clot-dissolving drug. This procedure presents…

Robotics · Computer Science 2024-12-18 Peiyao Zhang , Peter Gehlbach , Marin Kobilarov , Iulian Iordachita

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

Information Retrieval · Computer Science 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

Endoscopy is widely used to diagnose gastric cancer and has a high diagnostic performance, but it must be performed by a physician, which limits the number of people who can be diagnosed. In contrast, gastric X-rays can be taken by…

Image and Video Processing · Electrical Eng. & Systems 2025-02-06 Hideaki Okamoto , Quan Huu Cap , Takakiyo Nomura , Kazuhito Nabeshima , Jun Hashimoto , Hitoshi Iyatomi

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Current `dry lab' surgical phantom simulators are a valuable tool for surgeons which allows them to improve their dexterity and skill with surgical instruments. These phantoms mimic the haptic and shape of organs of interest, but lack a…

Computers and Society · Computer Science 2019-04-09 Sandy Engelhardt , Raffaele De Simone , Peter M. Full , Matthias Karck , Ivo Wolf

Offline Reinforcement Learning (RL) aims to turn large datasets into powerful decision-making engines without any online interactions with the environment. This great promise has motivated a large amount of research that hopes to replicate…

Machine Learning · Computer Science 2020-12-01 Louis Monier , Jakub Kmec , Alexandre Laterre , Thomas Pierrot , Valentin Courgeau , Olivier Sigaud , Karim Beguir

Automated patient positioning is a crucial step in streamlining MRI workflows and enhancing patient throughput. RGB-D camera-based systems offer a promising approach to automate this process by leveraging depth information to estimate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Eytan Kats , Kai Geißler , Jochen G. Hirsch , Stefan Heldman , Mattias P. Heinrich

Flexible endoscopes for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic devices together with autonomous control represent a viable…

We present Human to Humanoid (H2O), a reinforcement learning (RL) based framework that enables real-time whole-body teleoperation of a full-sized humanoid robot with only an RGB camera. To create a large-scale retargeted motion dataset of…

Robotics · Computer Science 2024-03-08 Tairan He , Zhengyi Luo , Wenli Xiao , Chong Zhang , Kris Kitani , Changliu Liu , Guanya Shi

We introduce a Virtual Reality (VR) one-on-one tutoring system to support anatomy education. A student uses a fully immersive VR headset to explore the anatomy of the base of the human skull. A teacher guides the student by using the…

Human-Computer Interaction · Computer Science 2020-11-17 Patrick Saalfeld , Anna Schmeier , Wolfgang D'Hanis , Hermann-Josef Rothkötter , Bernhard Preim

Contemporary progress in the field of robotics, marked by improved efficiency and stability, has paved the way for the global adoption of surgical robotic systems (SRS). While these systems enhance surgeons' skills by offering a more…

In this paper, we develop a virtual reality (VR) simulator for the Robossis robot-assisted femur fracture surgery. Due to the steep learning curve for such procedures, a VR simulator is essential for training surgeon(s) and staff. The…

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL). Our system, FastRLAP (faster lap), trains autonomously in the real world, without human…

Robotics · Computer Science 2023-04-20 Kyle Stachowicz , Dhruv Shah , Arjun Bhorkar , Ilya Kostrikov , Sergey Levine