English
Related papers

Related papers: SAM-U: Multi-box prompts triggered uncertainty est…

200 papers

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architecture is designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Théo Danielou , Daniel Tordjman , Pierre Manceron , Corentin Dancette

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest has led to the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jorge Quesada , Zoe Fowler , Mohammad Alotaibi , Mohit Prabhushankar , Ghassan AlRegib

In safety-critical applications like medical diagnosis, certainty associated with a model's prediction is just as important as its accuracy. Consequently, uncertainty estimation and reduction play a crucial role. Uncertainty in predictions…

Image and Video Processing · Electrical Eng. & Systems 2023-09-12 Abhishek Singh Sambyal , Narayanan C. Krishnan , Deepti R. Bathula

The Segment Anything Model (SAM) serves as a fundamental model for semantic segmentation and demonstrates remarkable generalization capabilities across a wide range of downstream scenarios. In this empirical study, we examine SAM's…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yidong Jiang

Large foundation models, known for their strong zero-shot generalization, have excelled in visual and language applications. However, applying them to medical image segmentation, a domain with diverse imaging types and target labels,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Junde Wu , Jiayuan Zhu , Yueming Jin , Min Xu

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

Current AI-assisted skin image diagnosis has achieved dermatologist-level performance in classifying skin cancer, driven by rapid advancements in deep learning architectures. However, unlike traditional vision tasks, skin images in general…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xin Hu , Janet Wang , Jihun Hamm , Rie R Yotsu , Zhengming Ding

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Huanli Zhuo , Leilei Ma , Haifeng Zhao , Shiwei Zhou , Dengdi Sun , Yanping Fu

Segment anything model (SAM) has presented impressive objectness identification capability with the idea of prompt learning and a new collected large-scale dataset. Given a prompt (e.g., points, bounding boxes, or masks) and an input image,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Yihao Huang , Yue Cao , Tianlin Li , Felix Juefei-Xu , Di Lin , Ivor W. Tsang , Yang Liu , Qing Guo

Purpose: To evaluate various Segmental Anything Model (SAM) prompt strategies across four lesions datasets and to subsequently develop a reinforcement learning (RL) agent to optimize SAM prompt placement. Materials and Methods: This…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Yuli Wang , Victoria Shi , Wen-Chi Hsu , Yuwei Dai , Sophie Yao , Zhusi Zhong , Zishu Zhang , Jing Wu , Aaron Maxwell , Scott Collins , Zhicheng Jiao , Harrison X. Bai

Foundation models, such as the Segment Anything Model (SAM), have heightened interest in promptable zero-shot segmentation. Although these models perform strongly on natural images, their behavior on medical data remains insufficiently…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Satrajit Chakrabarty , Ravi Soni

Despite strong zero-shot performance, SAM is unreliable under domain shift due to Mask-level Confidence Confusion (MCC), where a single IoU-based mask score fails to reflect pixel-wise reliability near boundaries. Motivated by the contrast…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hongyou Zhou , Marc Toussaint , Ling Shao , Zihan Ye

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

As large-scale foundation models trained on billions of image--mask pairs covering a vast diversity of scenes, objects, and contexts, SAM and its upgraded version, SAM~2, have significantly influenced multiple fields within computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoqi Zhao , Youwei Pang , Shijie Chang , Yuan Zhao , Lihe Zhang , Chenyang Yu , Hanqi Liu , Jiaming Zuo , Jinsong Ouyang , Weisi Lin , Georges El Fakhri , Huchuan Lu , Xiaofeng Liu