English
Related papers

Related papers: Temporally-Extended Prompts Optimization for SAM i…

200 papers

In medical imaging, precise annotation of lesions or organs is often required. However, 3D volumetric images typically consist of hundreds or thousands of slices, making the annotation process extremely time-consuming and laborious.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Bingzhi Shen , Lufan Chang , Siqi Chen , Shuxiang Guo , Hao Liu

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

Accurate tongue segmentation is crucial for reliable TCM analysis. Supervised models require large annotated datasets, while SAM-family models remain prompt-driven. We present Memory-SAM, a training-free, human-prompt-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Joongwon Chae , Lihui Luo , Xi Yuan , Dongmei Yu , Zhenglin Chen , Lian Zhang , Peiwu Qin

In medical image analysis, achieving fast, efficient, and accurate segmentation is essential for automated diagnosis and treatment. Although recent advancements in deep learning have significantly improved segmentation accuracy, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Li , Kai Zhao , Yaqi Wang , Shuai Wang

The Segment Anything Model (SAM), a vision foundation model, exhibits impressive zero-shot capabilities in general tasks but struggles in specialized domains. Parameter-efficient fine-tuning (PEFT) is a promising approach to unleash the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yuanhong Zhang , Muyao Yuan , Weizhan Zhang , Tieliang Gong , Wen Wen , Jiangyong Ying , Weijie Shi

One-shot medical image segmentation (MIS) is crucial for medical analysis due to the burden of medical experts on manual annotation. The recent emergence of the segment anything model (SAM) has demonstrated remarkable adaptation in MIS but…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Jia Wang , Yunan Mei , Jiarui Liu , Xin Fan

Multi-organ medical segmentation is a crucial component of medical image processing, essential for doctors to make accurate diagnoses and develop effective treatment plans. Despite significant progress in this field, current multi-organ…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Xinlei Yu , Changmiao Wang , Hui Jin , Ahmed Elazab , Gangyong Jia , Xiang Wan , Changqing Zou , Ruiquan Ge

Is Segment Anything Model 3 (SAM3) capable in segmenting Any Pathology Images? Digital pathology segmentation spans tissue-level and nuclei-level scales, where traditional methods often suffer from high annotation costs and poor…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qiuyu Kong , Shakiba Sharifi , Yiming Wang , Marco Cristani , Zanxi Ruan

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tyler Ward , Abdullah-Al-Zubaer Imran

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais