English
Related papers

Related papers: Revisiting the Evaluation Bias Introduced by Frame…

200 papers

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Segment anything model (SAM) has emerged as the leading approach for zero-shot learning in segmentation tasks, offering the advantage of avoiding pixel-wise annotations. It is particularly appealing in medical image segmentation, where the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Ziyi Huang , Hongshan Liu , Haofeng Zhang , Xueshen Li , Haozhe Liu , Fuyong Xing , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Short axis cardiac MRI segmentation is a well-researched topic, with excellent results achieved by state-of-the-art models in a supervised setting. However, annotating MRI volumes is time-consuming and expensive. Many different approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Josh Stein , Maxime Di Folco , Julia Schnabel

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 50.9K videos, SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Ange Lou , Yamin Li , Yike Zhang , Robert F. Labadie , Jack Noble

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Manish Sahu , Ronja Strömsdörfer , Anirban Mukhopadhyay , Stefan Zachow

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

Background: We evaluate SAM 2 for surgical scene understanding by examining its semantic segmentation capabilities for organs/tissues both in zero-shot scenarios and after fine-tuning. Methods: We utilized five public datasets to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Devanish N. Kamtam , Joseph B. Shrager , Satya Deepya Malla , Xiaohan Wang , Nicole Lin , Juan J. Cardona , Serena Yeung-Levy , Clarence Hu

Recent advances in medical image segmentation have been driven by deep learning; however, most existing methods remain limited by modality-specific designs and exhibit poor adaptability to dynamic medical imaging scenarios. The Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Guoping Xu , Christopher Kabat , You Zhang

Surgical scene segmentation is critical in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, referring surgical segmentation is emerging, given its advantage of providing surgeons with an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Haofeng Liu , Mingqi Gao , Xuxiao Luo , Ziyue Wang , Guanyi Qin , Junde Wu , Yueming Jin

The Segment Anything Model 2 (SAM 2) has emerged as a powerful foundation model for object segmentation in both images and videos, paving the way for various downstream video applications. The crucial design of SAM 2 for video segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shuangrui Ding , Rui Qian , Xiaoyi Dong , Pan Zhang , Yuhang Zang , Yuhang Cao , Yuwei Guo , Dahua Lin , Jiaqi Wang

Intelligent medical image segmentation methods are rapidly evolving and being increasingly applied, yet they face the challenge of domain transfer, where algorithm performance degrades due to different data distributions between source and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Andrew Seohwan Yu , Mohsen Hariri , Xuecen Zhang , Mingrui Yang , Vipin Chaudhary , Xiaojuan Li

The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-13 Nima Tajbakhsh , Laura Jeyaseelan , Qian Li , Jeffrey Chiang , Zhihao Wu , Xiaowei Ding

Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Jun Ma , Sumin Kim , Feifei Li , Mohammed Baharoon , Reza Asakereh , Hongwei Lyu , Bo Wang

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zhou Zheng , Yuichiro Hayashi , Masahiro Oda , Takayuki Kitasaka , Kensaku Mori

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

Recent temporal action segmentation approaches need frame annotations during training to be effective. These annotations are very expensive and time-consuming to obtain. This limits their performances when only limited annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Sovan Biswas , Anthony Rhodes , Ramesh Manuvinakurike , Giuseppe Raffa , Richard Beckwith