中文
相关论文

相关论文: Zero-Shot Surgical Tool Segmentation in Monocular …

200 篇论文

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models. While click and brush interactions are both well explored in…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Frano Rajič , Lei Ke , Yu-Wing Tai , Chi-Keung Tang , Martin Danelljan , Fisher Yu

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

Medical image segmentation and video object segmentation are essential for diagnosing and analyzing diseases by identifying and measuring biological structures. Recent advances in natural domain have been driven by foundation models like…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Zhiling Yan , Weixiang Sun , Rong Zhou , Zhengqing Yuan , Kai Zhang , Yiwei Li , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

图像与视频处理 · 电气工程与系统科学 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

Tracking cells and detecting mitotic events in time-lapse microscopy image sequences is a crucial task in biomedical research. However, it remains highly challenging due to dividing objects, low signal-tonoise ratios, indistinct boundaries,…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Zhu Chen , Mert Edgü , Er Jin , Johannes Stegmaier

The recent wave of foundation models has witnessed tremendous success in computer vision (CV) and beyond, with the segment anything model (SAM) having sparked a passion for exploring task-agnostic visual foundation models. Empowered by its…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Chunhui Zhang , Yawen Cui , Weilin Lin , Guanjie Huang , Yan Rong , Li Liu , Shiguang Shan

Interactive medical image segmentation (IMIS) has shown significant potential in enhancing segmentation accuracy by integrating iterative feedback from medical professionals. However, the limited availability of enough 3D medical data…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Chuyun Shen , Wenhao Li , Yuhang Shi , Xiangfeng Wang

As the successor to the Segment Anything Model (SAM), the Segment Anything Model 2 (SAM2) not only improves performance in image segmentation but also extends its capabilities to video segmentation. However, its effectiveness in segmenting…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Leiping Jie

Intelligent medical image segmentation methods are rapidly evolving and being increasingly applied, yet they face the challenge of domain transfer, where algorithm performance degrades due to different data distributions between source and…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Andrew Seohwan Yu , Mohsen Hariri , Xuecen Zhang , Mingrui Yang , Vipin Chaudhary , Xiaojuan Li

Despite significant advances in deep learning for image and video segmentation, existing models continue to face challenges in cross-domain adaptability and generalization. Image and video segmentation are fundamental tasks in computer…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Zhang Jiaxing , Tang Hao

Background: We evaluate SAM 2 for surgical scene understanding by examining its semantic segmentation capabilities for organs/tissues both in zero-shot scenarios and after fine-tuning. Methods: We utilized five public datasets to evaluate…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Devanish N. Kamtam , Joseph B. Shrager , Satya Deepya Malla , Xiaohan Wang , Nicole Lin , Juan J. Cardona , Serena Yeung-Levy , Clarence Hu

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

Few-shot semantic segmentation has recently attracted great attention. The goal is to develop a model capable of segmenting unseen classes using only a few annotated samples. Most existing approaches adapt a pre-trained model by training…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Bernardo Forni , Gabriele Lombardi , Federico Pozzi , Mirco Planamente

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

图像与视频处理 · 电气工程与系统科学 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical image segmentation benchmarks, covering various imaging…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Peilun Shi , Jianing Qiu , Sai Mu Dalike Abaxi , Hao Wei , Frank P. -W. Lo , Wu Yuan