中文
相关论文

相关论文: Task-driven Prompt Evolution for Foundation Models

200 篇论文

Promptable segmentation foundation models such as SAM3 have demonstrated strong generalization capabilities through interactive and concept-based prompting. However, their direct applicability to medical image segmentation remains limited…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Chongcong Jiang , Tianxingjian Ding , Chuhan Song , Jiachen Tu , Ziyang Yan , Yihua Shao , Zhenyi Wang , Yuzhang Shang , Tianyu Han , Yu Tian

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

The Segment Anything Model (SAM) can achieve satisfactory segmentation performance under high-quality box prompts. However, SAM's robustness is compromised by the decline in box quality, limiting its practicality in clinical reality. In…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Yuhao Huang , Xin Yang , Han Zhou , Yan Cao , Haoran Dou , Fajin Dong , Dong Ni

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

图像与视频处理 · 电气工程与系统科学 2023-08-14 Yichi Zhang , Rushi Jiao

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

In computer vision, fine-tuning is the de-facto approach to leverage pre-trained vision models to perform downstream tasks. However, deploying it in practice is quite challenging, due to adopting parameter inefficient global update and…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Xing Nie , Bolin Ni , Jianlong Chang , Gaomeng Meng , Chunlei Huo , Zhaoxiang Zhang , Shiming Xiang , Qi Tian , Chunhong Pan

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest has led to the…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jorge Quesada , Zoe Fowler , Mohammad Alotaibi , Mohit Prabhushankar , Ghassan AlRegib

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

Although the Segment Anything Model (SAM) is highly effective in natural image segmentation, it requires dependencies on prompts, which limits its applicability to medical imaging where manual prompts are often unavailable. Existing efforts…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Mengmeng Zhang , Xingyuan Dai , Yicheng Sun , Jing Wang , Yueyang Yao , Xiaoyan Gong , Fuze Cong , Feiyue Wang , Yisheng Lv

Image segmentation is a critical task in microscopy, essential for accurately analyzing and interpreting complex visual data. This task can be performed using custom models trained on domain-specific datasets, transfer learning from…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Kamyar Barakati , Utkarsh Pratiush , Sheryl L. Sanchez , Aditya Raghavan , Delia J. Milliron , Mahshid Ahmadi , Philip D. Rack , Sergei V. Kalinin

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based…

图像与视频处理 · 电气工程与系统科学 2025-07-03 Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang , Shiwei Zhu , Luyi Han , Jiong Zhang , Shanshan Wang , Ritse Mann , Qifeng Yu , Tao Tan

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

图像与视频处理 · 电气工程与系统科学 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Adapting large pre-trained foundation models, e.g., SAM, for medical image segmentation remains a significant challenge. A crucial step involves the formulation of a series of specialized prompts that incorporate specific clinical…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Xiuqi Zheng , Yuhang Zhang , Haoran Zhang , Hongrui Liang , Xueqi Bao , Zhuqing Jiang , Qicheng Lao