English
Related papers

Related papers: SAMAug: Point Prompt Augmentation for Segment Anyt…

200 papers

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yidong Jiang

Data augmentation methods enrich datasets with augmented data to improve the performance of neural networks. Recently, automated data augmentation methods have emerged, which automatically design augmentation strategies. Existing work…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Misgana Negassi , Diane Wagner , Alexander Reiterer

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

Data augmentation is an essential technique in improving the generalization of deep neural networks. The majority of existing image-domain augmentations either rely on geometric and structural transformations, or apply different kinds of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Morgan Heisler , Amin Banitalebi-Dehkordi , Yong Zhang

The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models. While click and brush interactions are both well explored in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Frano Rajič , Lei Ke , Yu-Wing Tai , Chi-Keung Tang , Martin Danelljan , Fisher Yu

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

Interactive segmentation is to segment the mask of the target object according to the user's interactive prompts. There are two mainstream strategies: early fusion and late fusion. Current specialist models utilize the early fusion strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Chongkai Yu , Ting Liu , Anqi Li , Xiaochao Qu , Chengjing Wu , Luoqi Liu , Xiaolin Hu

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

In this work, we propose SAM3D, a novel framework that is able to predict masks in 3D point clouds by leveraging the Segment-Anything Model (SAM) in RGB images without further training or finetuning. For a point cloud of a 3D scene with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yunhan Yang , Xiaoyang Wu , Tong He , Hengshuang Zhao , Xihui Liu

The recent Segment Anything Models (SAMs) have emerged as foundational visual models for general interactive segmentation. Despite demonstrating robust generalization abilities, they still suffer performance degradations in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuan Yao , Qiushi Yang , Miaomiao Cui , Liefeng Bo

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang