English
Related papers

Related papers: S4M: 4-points to Segment Anything

200 papers

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Nucleus instance segmentation in histology images is crucial for a broad spectrum of clinical applications. Current dominant algorithms rely on regression of nuclear proxy maps. Distinguishing nucleus instances from the estimated maps…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhongyi Shui , Yunlong Zhang , Kai Yao , Chenglu Zhu , Sunyi Zheng , Jingxiong Li , Honglin Li , Yuxuan Sun , Ruizhe Guo , Lin Yang

The recent emergence of the Segment Anything Model (SAM) enables various domain-specific segmentation tasks to be tackled cost-effectively by using bounding boxes as prompts. However, in scene text segmentation, SAM can not achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Enze Xie , Jiaho Lyu , Daiqing Wu , Huawen Shen , Yu Zhou

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jinfeng Wang , Sifan Song , Xinkun Wang , Yiyi Wang , Yiyi Miao , Jionglong Su , S. Kevin Zhou

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

The Medical Segment Anything Model (MedSAM) has shown remarkable performance in medical image segmentation, drawing significant attention in the field. However, its sensitivity to varying prompt types and locations poses challenges. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Nan Zhou , Ke Zou , Kai Ren , Mengting Luo , Linchao He , Meng Wang , Yidi Chen , Yi Zhang , Hu Chen , Huazhu Fu

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Purpose: The recent Segment Anything Model (SAM) has demonstrated impressive performance with point, text or bounding box prompts, in various applications. However, in safety-critical surgical tasks, prompting is not possible due to (i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyang Sheng , Sophia Bano , Matthew J. Clarkson , Mobarakol Islam

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

Recently, Segment Anything Model (SAM) has demonstrated strong generalizability in various instance segmentation tasks. However, its performance is severely dependent on the quality of manual prompts. In addition, the RGB images that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yihan Shang , Wei Wang , Chao Huang , Xinghui Dong

Localizing object parts precisely is essential for tasks such as object recognition and robotic manipulation. Recent part segmentation methods require extensive training data and labor-intensive annotations. Segment-Anything Model (SAM) has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 S. B. van Rooij , G. J. Burghouts

The Segment Anything Model (SAM) is a recently developed all-range foundation model for image segmentation. It can use sparse manual prompts such as bounding boxes to generate pixel-level segmentation in natural images but struggles in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xing Yao , Han Liu , Dewei Hu , Daiwei Lu , Ange Lou , Hao Li , Ruining Deng , Gabriel Arenas , Baris Oguz , Nadav Schwartz , Brett C Byram , Ipek Oguz

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Tyler Ward , Meredith K. Owen , O'Kira Coleman , Brian Noehren , Abdullah-Al-Zubaer Imran