English
Related papers

Related papers: SAM2-SGP: Enhancing SAM2 for Medical Image Segment…

200 papers

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and its variants necessitate substantial manual effort for prompt generation and additional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Minjae Lee , Sungwoo Hur , Soojin Hwang , Won Hwa Kim

We present SAMSA 2.0, an interactive segmentation framework for hyperspectral medical imaging that introduces spectral angle prompting to guide the Segment Anything Model (SAM) using spectral similarity alongside spatial cues. This early…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Alfie Roddan , Tobias Czempiel , Chi Xu , Daniel S. Elson , Stamatia Giannarou

This paper introduces SAMAug, a novel visual point augmentation method for the Segment Anything Model (SAM) that enhances interactive image segmentation performance. SAMAug generates augmented point prompts to provide more information about…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Haixing Dai , Chong Ma , Zhiling Yan , Zhengliang Liu , Enze Shi , Yiwei Li , Peng Shu , Xiaozheng Wei , Lin Zhao , Zihao Wu , Fang Zeng , Dajiang Zhu , Wei Liu , Quanzheng Li , Lichao Sun , Shu Zhang Tianming Liu , Xiang Li

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Medical image segmentation of anatomical structures and pathology is crucial in modern clinical diagnosis, disease study, and treatment planning. To date, great progress has been made in deep learning-based segmentation techniques, but most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

The field of medical image segmentation is hindered by the scarcity of large, publicly available annotated datasets. Not all datasets are made public for privacy reasons, and creating annotations for a large dataset is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Iira Häkkinen , Iaroslav Melekhov , Erik Englesson , Hossein Azizpour , Juho Kannala

The recent advancements in large-scale pre-training techniques have significantly enhanced the capabilities of vision foundation models, notably the Segment Anything Model (SAM), which can generate precise masks based on point and box…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Anqi Zhang , Guangyu Gao , Jianbo Jiao , Chi Harold Liu , Yunchao Wei

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo

Segment Anything Model 2 (SAM2) exhibits strong generalisation for promptable segmentation in video clips; however, its integration with the audio modality remains underexplored. Existing approaches either convert audio into visual prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yuyuan Liu , Yuanhong Chen , Chong Wang , Junlin Han , Junde Wu , Can Peng , Jingkun Chen , Yu Tian , Gustavo Carneiro

Weakly supervised landslide extraction aims to identify landslide regions from remote sensing data using models trained with weak labels, particularly image-level labels. However, it is often challenged by the imprecise boundaries of the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jian Wang , Xiaokang Zhang , Xianping Ma , Weikang Yu , Pedram Ghamisi

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yidong Jiang

Camouflaged object detection (COD) approaches heavily rely on pixel-level annotated datasets. Weakly-supervised COD (WSCOD) approaches use sparse annotations like scribbles or points to reduce annotation effort, but this can lead to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jian Hu , Jiayi Lin , Weitong Cai , Shaogang Gong

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

The Segment Anything Model (SAM) can achieve satisfactory segmentation performance under high-quality box prompts. However, SAM's robustness is compromised by the decline in box quality, limiting its practicality in clinical reality. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuhao Huang , Xin Yang , Han Zhou , Yan Cao , Haoran Dou , Fajin Dong , Dong Ni

The Segment Anything Model (SAM) and CLIP are remarkable vision foundation models (VFMs). SAM, a prompt driven segmentation model, excels in segmentation tasks across diverse domains, while CLIP is renowned for its zero shot recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Sidra Aleem , Fangyijie Wang , Mayug Maniparambil , Eric Arazo , Julia Dietlmeier , Guenole Silvestre , Kathleen Curran , Noel E. O'Connor , Suzanne Little

Accurate segmentation of neural structures in Electron Microscopy (EM) images is paramount for neuroscience. However, this task is challenged by intricate morphologies, low signal-to-noise ratios, and scarce annotations, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenghua Li , Hang Chen , Zihao Sun , Kai Li , Xiaolin Hu

Medical image segmentation is crucial for clinical decision-making, but the scarcity of annotated data presents significant challenges. Few-shot segmentation (FSS) methods show promise but often require training on the target domain and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lin Zhao , Xiao Chen , Eric Z. Chen , Yikang Liu , Terrence Chen , Shanhui Sun

Purpose: The recent Segment Anything Model (SAM) has demonstrated impressive performance with point, text or bounding box prompts, in various applications. However, in safety-critical surgical tasks, prompting is not possible due to (i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyang Sheng , Sophia Bano , Matthew J. Clarkson , Mobarakol Islam