English
Related papers

Related papers: Prompt-Free and Efficient SAM2 Adaptation for Biom…

200 papers

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

Referring Remote Sensing Image Segmentation (RRSIS) aims to segment target objects in remote sensing (RS) images based on textual descriptions. Although Segment Anything Model 2 (SAM2) has shown remarkable performance in various…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

Source-free domain adaptation (SFDA) for segmentation aims at adapting a model trained in the source domain to perform well in the target domain with only the source model and unlabeled target data. Inspired by the recent success of Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zheang Huai , Hui Tang , Yi Li , Zhuangzhuang Chen , Xiaomeng Li

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Jun Ma , Sumin Kim , Feifei Li , Mohammed Baharoon , Reza Asakereh , Hongwei Lyu , Bo Wang

We propose a straightforward yet highly effective few-shot fine-tuning strategy for adapting the Segment Anything (SAM) to anatomical segmentation tasks in medical images. Our novel approach revolves around reformulating the mask decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Weiyi Xie , Nathalie Willems , Shubham Patil , Yang Li , Mayank Kumar

The Segment Anything Model (SAM) demonstrates impressive zero-shot segmentation ability on natural images but encounters difficulties in medical imaging due to domain shifts, anatomical variability, and its reliance on user-provided…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yingzhen Hu , Yiheng Zhong , Ruobing Li , Yingxue Su , Jiabao An , Feilong Tang , Jionglong Su , Imran Razzak

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

The recent Segment Anything Model (SAM) has demonstrated remarkable zero-shot capability and flexible geometric prompting in general image segmentation. However, SAM often struggles when handling various unconventional images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Ruijie Ren , Xiaoqin Zhang , Ling Shao , Shijian Lu

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

Medical image segmentation plays a pivotal role in clinical diagnostics and treatment planning, yet existing models often face challenges in generalization and in handling both 2D and 3D data uniformly. In this paper, we introduce Medical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiayuan Zhu , Abdullah Hamdi , Yunli Qi , Yueming Jin , Junde Wu

In medical image analysis, achieving fast, efficient, and accurate segmentation is essential for automated diagnosis and treatment. Although recent advancements in deep learning have significantly improved segmentation accuracy, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Li , Kai Zhao , Yaqi Wang , Shuai Wang

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yidong Jiang

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan