中文
相关论文

相关论文: Task-driven Prompt Evolution for Foundation Models

200 篇论文

Foundation models pre-trained on large-scale data have been widely witnessed to achieve success in various natural imaging downstream tasks. Parameter-efficient fine-tuning (PEFT) methods aim to adapt foundation models to new domains by…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Wenqiang Zu , Shenghao Xie , Qing Zhao , Guoqi Li , Lei Ma

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

计算机视觉与模式识别 · 计算机科学 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

图像与视频处理 · 电气工程与系统科学 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Tyler Ward , Abdullah Imran

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Yuheng Li , Yuxiang Lai , Maria Thor , Deborah Marshall , Zachary Buchwald , David S. Yu , Xiaofeng Yang

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has…

图像与视频处理 · 电气工程与系统科学 2024-01-25 Saiyang Na , Yuzhi Guo , Feng Jiang , Hehuan Ma , Junzhou Huang

Segmentation is an important analysis task for biomedical images, enabling the study of individual organelles, cells or organs. Deep learning has massively improved segmentation methods, but challenges remain in generalization to new…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Carolin Teuber , Anwai Archit , Constantin Pape

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class agnostic and heavily…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Duojun Huang , Xinyu Xiong , Jie Ma , Jichang Li , Zequn Jie , Lin Ma , Guanbin Li

The performance of image segmentation models has historically been constrained by the high cost of collecting large-scale annotated data. The Segment Anything Model (SAM) alleviates this original problem through a promptable,…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

Leveraging pre-trained models with tailored prompts for in-context learning has proven highly effective in NLP tasks. Building on this success, recent studies have applied a similar approach to the Segment Anything Model (SAM) within a…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Hangyul Yoon , Doohyuk Jang , Jungeun Kim , Eunho Yang

The Segmentation Anything Model (SAM) has recently emerged as a foundation model for addressing image segmentation. Owing to the intrinsic complexity of medical images and the high annotation cost, the medical image segmentation (MIS)…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Chuyun Shen , Wenhao Li , Ya Zhang , Xiangfeng Wang

Vision foundation models have demonstrated exceptional generalization capabilities in segmentation tasks for both generic and specialized images. However, a performance gap persists between foundation models and task-specific, specialized…

计算机视觉与模式识别 · 计算机科学 2025-01-31 Chengxi Zeng , David Smithard , Alberto M Gambaruto , Tilo Burghardt

Cell segmentation is a fundamental task in microscopy image analysis. Several foundation models for cell segmentation have been introduced, virtually all of them are extensions of Segment Anything Model (SAM), improving it for microscopy…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Anwai Archit , Constantin Pape

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang