English
Related papers

Related papers: Learning to Prompt Segment Anything Models

200 papers

Precision medicine, such as patient-adaptive treatments assisted by medical image analysis, poses new challenges for segmentation algorithms in adapting to new patients, due to the large variability across different patients and the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chenhui Zhao , Liyue Shen

Pixel-level vision tasks, such as semantic segmentation, require extensive and high-quality annotated data, which is costly to obtain. Semi-supervised semantic segmentation (SSSS) has emerged as a solution to alleviate the labeling burden…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Danhui Chen , Ziquan Liu , Chuxi Yang , Dan Wang , Yan Yan , Yi Xu , Xiangyang Ji

The Segment Anything Model (SAM) represents a significant breakthrough into foundation models for computer vision, providing a large-scale image segmentation model. However, despite SAM's zero-shot performance, its segmentation masks lack…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Xianjie Liu , Keren Fu , Yao Jiang , Qijun Zhao

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

In geographical image segmentation, performance is often constrained by the limited availability of training data and a lack of generalizability, particularly for segmenting mobility infrastructure such as roads, sidewalks, and crosswalks.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Rafi Ibn Sultan , Chengyin Li , Hui Zhu , Prashant Khanduri , Marco Brocanelli , Dongxiao Zhu

The Segment Anything Model (SAM) serves as a fundamental model for semantic segmentation and demonstrates remarkable generalization capabilities across a wide range of downstream scenarios. In this empirical study, we examine SAM's…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Segment Anything Model (SAM) is a foundation model for semantic segmentation and shows excellent generalization capability with the prompts. In this empirical study, we investigate the robustness and zero-shot generalizability of the SAM in…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

Research has focused on Multi-Modal Semantic Segmentation (MMSS), where pixel-wise predictions are derived from multiple visual modalities captured by diverse sensors. Recently, the large vision model, Segment Anything Model 2 (SAM2), has…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Chenfei Liao , Xu Zheng , Yuanhuiyi Lyu , Haiwei Xue , Yihong Cao , Jiawen Wang , Kailun Yang , Xuming Hu

Segment Anything Model (SAM) has made great progress in anomaly segmentation tasks due to its impressive generalization ability. However, existing methods that directly apply SAM through prompting often overlook the domain shift issue,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Hui-Yue Yang , Hui Chen , Ao Wang , Kai Chen , Zijia Lin , Yongliang Tang , Pengcheng Gao , Yuming Quan , Jungong Han , Guiguang Ding

The recent advancements in large foundation models have driven the success of open-set image segmentation, a task focused on segmenting objects beyond predefined categories. Among various prompt types (such as points, boxes, texts, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaoqi Wang , Clint Sebastian , Wenbin He , Liu Ren

Few-shot learning is a challenging problem since only a few examples are provided to recognize a new class. Several recent studies exploit additional semantic information, e.g. text embeddings of class names, to address the issue of rare…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Wentao Chen , Chenyang Si , Zhang Zhang , Liang Wang , Zilei Wang , Tieniu Tan

The Segment Anything Model (SAM), introduced to the computer vision community by Meta in April 2023, is a groundbreaking tool that allows automated segmentation of objects in images based on prompts such as text, clicks, or bounding boxes.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Athulya Sundaresan Geetha , Muhammad Hussain

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

The recently proposed Segment Anything Model (SAM) is a general tool for image segmentation, but it requires additional adaptation and careful fine-tuning for medical image segmentation, especially for small, irregularly-shaped, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Yaxi Chen , Aleksandra Ivanova , Shaheer U. Saeed , Rikin Hargunani , Jie Huang , Chaozong Liu , Yipeng Hu

The primary challenge of cross-domain few-shot segmentation (CD-FSS) is the domain disparity between the training and inference phases, which can exist in either the input data or the target classes. Previous models struggle to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Shi-Feng Peng , Guolei Sun , Yong Li , Hongsong Wang , Guo-Sen Xie

Existing promptable segmentation methods in the medical imaging field primarily consider either textual or visual prompts to segment relevant objects, yet they often fall short when addressing anomalies in medical images, like tumors, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhongzhen Huang , Yankai Jiang , Rongzhao Zhang , Shaoting Zhang , Xiaofan Zhang

Large Vision-Language Models (VLMs) are increasingly being regarded as foundation models that can be instructed to solve diverse tasks by prompting, without task-specific training. We examine the seemingly obvious question: how to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Niccolo Avogaro , Thomas Frick , Mattia Rigotti , Andrea Bartezzaghi , Filip Janicki , Cristiano Malossi , Konrad Schindler , Roy Assaf