中文
相关论文

相关论文: Curriculum Prompting Foundation Models for Medical…

200 篇论文

Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and its variants necessitate substantial manual effort for prompt generation and additional…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Minjae Lee , Sungwoo Hur , Soojin Hwang , Won Hwa Kim

Task-generic promptable image segmentation aims to achieve segmentation of diverse samples under a single task description by utilizing only one task-generic prompt. Current methods leverage the generalization capabilities of…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Jian Hu , Zixu Cheng , Shaogang Gong

With the popularity of foundational models, parameter efficient fine tuning has become the defacto approach to leverage pretrained models to perform downstream tasks. Taking inspiration from recent advances in large language models, Visual…

图像与视频处理 · 电气工程与系统科学 2025-01-08 Aadya Arora , Vinay Namboodiri

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

Segment anything model (SAM), a foundation model with superior versatility and generalization across diverse segmentation tasks, has attracted widespread attention in medical imaging. However, it has been proved that SAM would encounter…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xian Lin , Yangyang Xiang , Zhehao Wang , Kwang-Ting Cheng , Zengqiang Yan , Li Yu

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

计算机视觉与模式识别 · 计算机科学 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

The objective of this work is to explore how to effectively and efficiently adapt pre-trained visual foundation models to various downstream tasks of semantic segmentation. Previous methods usually fine-tuned the entire networks for each…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Lingbo Liu , Jianlong Chang , Bruce X. B. Yu , Liang Lin , Qi Tian , Chang-Wen Chen

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

音频与语音处理 · 电气工程与系统科学 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

In this work, we present SEEM, a promptable and interactive model for segmenting everything everywhere all at once in an image, as shown in Fig.1. In SEEM, we propose a novel decoding mechanism that enables diverse prompting for all types…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Xueyan Zou , Jianwei Yang , Hao Zhang , Feng Li , Linjie Li , Jianfeng Wang , Lijuan Wang , Jianfeng Gao , Yong Jae Lee

One-shot semantic image segmentation aims to segment the object regions for the novel class with only one annotated image. Recent works adopt the episodic training strategy to mimic the expected situation at testing time. However, these…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Tao Chen , Guosen Xie , Yazhou Yao , Qiong Wang , Fumin Shen , Zhenmin Tang , Jian Zhang

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

This work introduces a new framework, ProtoSAM, for one-shot medical image segmentation. It combines the use of prototypical networks, known for few-shot segmentation, with SAM - a natural image foundation model. The method proposed creates…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Lev Ayzenberg , Raja Giryes , Hayit Greenspan

Purpose: The Segment Anything Model (SAM) promises to ease the annotation bottleneck in medical segmentation, but overlapping anatomy and blurred boundaries make its point prompts ambiguous, leading to cycles of manual refinement to achieve…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Adrien Meyer , Lorenzo Arboit , Giuseppe Massimiani , Shih-Min Yin , Didier Mutter , Nicolas Padoy

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

Segmentation models such as Segment Anything Model (SAM) and SAM2 achieve strong prompt-driven zero-shot performance. However, their training on natural images limits domain transfer to medical data. Consequently, accurate segmentation…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Tal Grossman , Noa Cahan , Lev Ayzenberg , Hayit Greenspan

Purpose: The recent Segment Anything Model (SAM) has demonstrated impressive performance with point, text or bounding box prompts, in various applications. However, in safety-critical surgical tasks, prompting is not possible due to (i) the…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yuyang Sheng , Sophia Bano , Matthew J. Clarkson , Mobarakol Islam

Image segmentation is a long-standing challenge in computer vision, studied continuously over several decades, as evidenced by seminal algorithms such as N-Cut, FCN, and MaskFormer. With the advent of foundation models (FMs), contemporary…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Tianfei Zhou , Wang Xia , Fei Zhang , Boyu Chang , Wenguan Wang , Ye Yuan , Ender Konukoglu , Daniel Cremers