English
Related papers

Related papers: Zero-Shot Surgical Tool Segmentation in Monocular …

200 papers

We propose a straightforward yet highly effective few-shot fine-tuning strategy for adapting the Segment Anything (SAM) to anatomical segmentation tasks in medical images. Our novel approach revolves around reformulating the mask decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Weiyi Xie , Nathalie Willems , Shubham Patil , Yang Li , Mayank Kumar

With breakthroughs in large-scale modeling, the Segment Anything Model (SAM) and its extensions have been attempted for applications in various underwater visualization tasks in marine sciences, and have had a significant impact on the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shijie Lian , Hua Li

3D teeth segmentation, involving the localization of tooth instances and their semantic categorization in 3D dental models, is a critical yet challenging task in digital dentistry due to the complexity of real-world dentition. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Zhiguo Lu , Jianwen Lou , Mingjun Ma , Hairong Jin , Youyi Zheng , Kun Zhou

Medical image segmentation is crucial for clinical decision-making, but the scarcity of annotated data presents significant challenges. Few-shot segmentation (FSS) methods show promise but often require training on the target domain and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lin Zhao , Xiao Chen , Eric Z. Chen , Yikang Liu , Terrence Chen , Shanhui Sun

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

We present SAMSA 2.0, an interactive segmentation framework for hyperspectral medical imaging that introduces spectral angle prompting to guide the Segment Anything Model (SAM) using spectral similarity alongside spatial cues. This early…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Alfie Roddan , Tobias Czempiel , Chi Xu , Daniel S. Elson , Stamatia Giannarou

Summary: SAMRI is an MRI-specialized adaptation of the Segment Anything Model achieving superior whole-body MRI segmentation, particularly for small and clinically critical structures, through box and point prompts for rapid annotation.…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Zhao Wang , Wei Dai , Thuy Thanh Dao , Steffen Bollmann , Hongfu Sun , Craig Engstrom , Shekhar S. Chandra

Purpose: Foundation models, trained on multitudes of public datasets, often require additional fine-tuning or re-prompting mechanisms to be applied to visually distinct target domains such as surgical videos. Further, without domain…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Ssharvien Kumar Sivakumar , Yannik Frisch , Amin Ranem , Anirban Mukhopadhyay

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

The Segment Anything Model (SAM) is a powerful foundation model for image segmentation, showing robust zero-shot generalization through prompt engineering. However, relying on manual prompts is impractical for real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yi Chen , Mu-Young Son , Chuanbo Hua , Joo-Young Kim

Segment Anything Model 2 (SAM 2) has demonstrated strong performance in object segmentation tasks and has become the state-of-the-art for visual object tracking. The model stores information from previous frames in a memory bank, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Alen Adamyan , Tomáš Čížek , Matej Straka , Klara Janouskova , Martin Schmid

This report presents a framework called Segment And Track Anything (SAMTrack) that allows users to precisely and effectively segment and track any object in a video. Additionally, SAM-Track employs multimodal interaction methods that enable…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yangming Cheng , Liulei Li , Yuanyou Xu , Xiaodi Li , Zongxin Yang , Wenguan Wang , Yi Yang

The recent Segment Anything Model (SAM) has demonstrated remarkable zero-shot capability and flexible geometric prompting in general image segmentation. However, SAM often struggles when handling various unconventional images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Ruijie Ren , Xiaoqin Zhang , Ling Shao , Shijian Lu

Creating annotations for 3D medical data is time-consuming and often requires highly specialized expertise. Various tools have been implemented to aid this process. Segment Anything Model 2 (SAM 2) offers a general-purpose prompt-based…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Zafer Yildiz , Yuwen Chen , Maciej A. Mazurowski

Multimodal Large Language Models (MLLMs) have demonstrated strong image-level visual understanding and reasoning, yet their pixel-level perception across both images and videos remains limited. Foundation segmentation models such as the SAM…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hao Wang , Limeng Qiao , Chi Zhang , Lin Ma , Guanglu Wan , Xiangyuan Lan , Xiaodan Liang

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

On top of Segment Anything Model (SAM), SAM 2 further extends its capability from image to video inputs through a memory bank mechanism and obtains a remarkable performance compared with previous methods, making it a foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chong Zhou , Chenchen Zhu , Yunyang Xiong , Saksham Suri , Fanyi Xiao , Lemeng Wu , Raghuraman Krishnamoorthi , Bo Dai , Chen Change Loy , Vikas Chandra , Bilge Soran

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo