English
Related papers

Related papers: EndoARSS: Adapting Spatially-Aware Foundation Mode…

200 papers

Robotic-assisted surgery allows surgeons to conduct precise surgical operations with stereo vision and flexible motor control. However, the lack of 3D spatial perception limits situational awareness during procedures and hinders mastering…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Shang Zhao , Ce Wang , Qiyuan Wang , Yanzhe Liu , S Kevin Zhou

Medical image segmentation has significantly benefitted thanks to deep learning architectures. Furthermore, semi-supervised learning (SSL) has recently been a growing trend for improving a model's overall performance by leveraging abundant…

Image and Video Processing · Electrical Eng. & Systems 2021-10-05 S. M. Kamrul Hasan , Cristian A. Linte

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Anomaly detection and classification in medical imaging are critical for early diagnosis but remain challenging due to limited annotated data, class imbalance, and the high cost of expert labeling. Emerging vision foundation models such as…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Fazle Rafsani , Jay Shah , Catherine D. Chong , Todd J. Schwedt , Teresa Wu

Endoscopic surgery relies on intraoperative video, making image quality a decisive factor for surgical safety and efficacy. Yet, endoscopic videos are often degraded by uneven illumination, tissue scattering, occlusions, and motion blur,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Handing Xu , Zhenguo Nie , Tairan Peng , Huimin Pan , Xin-Jun Liu

In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of surgeon, so it can take appropriate assisting actions. In…

In image-assisted minimally invasive surgeries (MIS), understanding surgical scenes is vital for real-time feedback to surgeons, skill evaluation, and improving outcomes through collaborative human-robot procedures. Within this context, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mithun Parab , Pranay Lendave , Jiyoung Kim , Thi Quynh Dan Nguyen , Palash Ingle

Recent advancements in computer vision have significantly improved image analysis tasks. Yet, deep learning models often struggle when applied to domains outside their training distribution, such as in geosciences, where domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Florent Brondolo , Samuel Beaussant

Robot-assisted surgeries rely on accurate and real-time scene understanding to safely guide surgical instruments. However, segmentation models trained on static datasets face key limitations when deployed in these dynamic and evolving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Julia Hindel , Ema Mekic , Enamundram Naga Karthik , Rohit Mohan , Daniele Cattaneo , Maria Kalweit , Abhinav Valada

We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask decoder in a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Elias Stenhede , Agnar Martin Bjørnstad , Arian Ranjbar

Proficiency in microanastomosis is a critical surgical skill in neurosurgery, where the ability to precisely manipulate fine instruments is crucial to successful outcomes. These procedures require sustained attention, coordinated hand…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yan Meng , Daniel Donoho , Marcelle Altshuler , Omar Arnaout

Low-Rank Adaptation (LoRA) is widely adopted for downstream fine-tuning of foundation models due to its efficiency and zero additional inference cost. Many real-world applications require foundation models to specialize in several specific…

Machine Learning · Computer Science 2025-09-30 Jian Liang , Wenke Huang , Xianda Guo , Guancheng Wan , Bo Du , Mang Ye

Minimally Invasive Surgeries (MIS) are challenging for surgeons due to the limited field of view and constrained range of motion imposed by narrow access ports. These challenges can be addressed by robot-assisted endoscope systems which…

Robotics · Computer Science 2024-06-17 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

With the advent of robot-assisted surgery, the role of data-driven approaches to integrate statistics and machine learning is growing rapidly with prominent interests in objective surgical skill assessment. However, most existing work…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ziheng Wang , Ann Majewicz Fey

The Segment Anything Model (SAM), with its remarkable zero-shot capability, has been proven to be a powerful foundation model for image segmentation tasks, which is an important task in computer vision. However, the transfer of its rich…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xuehao Wang , Feiyang Ye , Yu Zhang

Multi-organ segmentation is one of most successful applications of deep learning in medical image analysis. Deep convolutional neural nets (CNNs) have shown great promise in achieving clinically applicable image segmentation performance on…

Image and Video Processing · Electrical Eng. & Systems 2020-12-18 Hao Tang , Xingwei Liu , Kun Han , Shanlin Sun , Narisu Bai , Xuming Chen , Huang Qian , Yong Liu , Xiaohui Xie

Surgical workflow anticipation is the task of predicting the timing of relevant surgical events from live video data, which is critical in Robotic-Assisted Surgery (RAS). Accurate predictions require the use of spatial information to model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Francis Xiatian Zhang , Jingjing Deng , Robert Lieck , Hubert P. H. Shum

Robotic-assisted surgery (RAS) is central to modern surgery, driving the need for intelligent systems with accurate scene understanding. Most existing surgical AI methods rely on isolated, task-specific models, leading to fragmented…

Artificial Intelligence · Computer Science 2026-02-19 Chang Han Low , Ziyue Wang , Tianyi Zhang , Zhu Zhuo , Zhitao Zeng , Evangelos B. Mazomenos , Yueming Jin

Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video recording is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Sabrina Kletz , Klaus Schoeffmann , Jenny Benois-Pineau , Heinrich Husslein