中文
相关论文

相关论文: Task-driven Prompt Evolution for Foundation Models

200 篇论文

Segment anything model (SAM), a foundation model with superior versatility and generalization across diverse segmentation tasks, has attracted widespread attention in medical imaging. However, it has been proved that SAM would encounter…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xian Lin , Yangyang Xiang , Zhehao Wang , Kwang-Ting Cheng , Zengqiang Yan , Li Yu

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

The Segment Anything Model (SAM) has recently demonstrated significant potential in medical image segmentation. Although SAM is primarily trained on 2D images, attempts have been made to apply it to 3D medical image segmentation. However,…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Fangda Chen , Jintao Tang , Pancheng Wang , Ting Wang , Shasha Li , Ting Deng

Segment Anything Model (SAM) has made great progress in anomaly segmentation tasks due to its impressive generalization ability. However, existing methods that directly apply SAM through prompting often overlook the domain shift issue,…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Hui-Yue Yang , Hui Chen , Ao Wang , Kai Chen , Zijia Lin , Yongliang Tang , Pengcheng Gao , Yuming Quan , Jungong Han , Guiguang Ding

The Segment Anything Model (SAM) has demonstrated strong performance in image segmentation of natural scene images. However, its effectiveness diminishes markedly when applied to specific scientific domains, such as Scanning Probe…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Yao Shen , Ziwei Wei , Chunmeng Liu , Shuming Wei , Qi Zhao , Kaiyang Zeng , Guangyao Li

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Shayan Jalilian , Abdul Bais

Promptable Foundation Models (FMs), initially introduced for natural image segmentation, have also revolutionized medical image segmentation. The increasing number of models, along with evaluations varying in datasets, metrics, and compared…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Caroline Magg , Maaike A. ter Wee , Johannes G. G. Dobbe , Geert J. Streekstra , Leendert Blankevoort , Clara I. Sánchez , Hoel Kervadec

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo

The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Josh Stein , Maxime Di Folco , Julia A. Schnabel

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical…

The rise of foundation models has shifted focus from resource-intensive fine-tuning to prompt engineering, a paradigm that steers model behavior through input design rather than weight updates. While manual prompt engineering faces…

人工智能 · 计算机科学 2025-02-18 Wenwu Li , Xiangfeng Wang , Wenhao Li , Bo Jin

There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a…

计算与语言 · 计算机科学 2022-03-18 Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

图像与视频处理 · 电气工程与系统科学 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Semantic segmentations of pathological entities have crucial clinical value in computational pathology workflows. Foundation models, such as the Segment Anything Model (SAM), have been recently proposed for universal use in segmentation…

图像与视频处理 · 电气工程与系统科学 2023-07-20 Jingwei Zhang , Ke Ma , Saarthak Kapse , Joel Saltz , Maria Vakalopoulou , Prateek Prasanna , Dimitris Samaras

Foundation models have rapidly evolved and have achieved significant accomplishments in computer vision tasks. Specifically, the prompt mechanism conveniently allows users to integrate image prior information into the model, making it…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Handi Deng , Yucheng Zhou , Jiaxuan Xiang , Liujie Gu , Yan Luo , Hai Feng , Mingyuan Liu , Cheng Ma

Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architecture is designed for…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Théo Danielou , Daniel Tordjman , Pierre Manceron , Corentin Dancette

The Segment Anything Model (SAM) has demonstrated impressive generalization in prompt-based segmentation. Yet, the potential of semantic text prompts remains underexplored compared to traditional spatial prompts like points and boxes. This…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Shayan Jalilian , Abdul Bais