English
Related papers

Related papers: Curriculum Prompting Foundation Models for Medical…

200 papers

Multi-organ medical segmentation is a crucial component of medical image processing, essential for doctors to make accurate diagnoses and develop effective treatment plans. Despite significant progress in this field, current multi-organ…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Xinlei Yu , Changmiao Wang , Hui Jin , Ahmed Elazab , Gangyong Jia , Xiang Wan , Changqing Zou , Ruiquan Ge

The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging for existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Qin Liu , Jaemin Cho , Mohit Bansal , Marc Niethammer

While 3D foundational models have shown promise for promptable segmentation of medical volumes, their robustness to imprecise prompts remains under-explored. In this work, we aim to address this gap by systematically studying the effect of…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Soumitri Chattopadhyay , Basar Demir , Marc Niethammer

Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Huaqian Wu , Clara Brémond-Martin , Kévin Bouaou , Cédric Clouchoux

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yidong Jiang

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Leveraging the extensive training data from SA-1B, the Segment Anything Model (SAM) demonstrates remarkable generalization and zero-shot capabilities. However, as a category-agnostic instance segmentation method, SAM heavily relies on prior…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Keyan Chen , Chenyang Liu , Hao Chen , Haotian Zhang , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaoyang Chen , Hao Zheng , Yifang Xie , Yuncong Ma , Tengfei Li

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

Semantic segmentation of microscopic cell images using deep learning is an important technique, however, it requires a large number of images and ground truth labels for training. To address the above problem, we consider an efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Sota Kato , Kazuhiro Hotta

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Josh Stein , Maxime Di Folco , Julia A. Schnabel

Foundation models such as Segment Anything Model 3 (SAM3) enable flexible text-guided medical image segmentation, yet their predictions remain highly sensitive to prompt formulation. Even semantically equivalent descriptions can yield…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yonghuang Wu , Zhenyang Liang , Wenwen Zeng , Xuan Xie , Jinhua Yu

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang