English
Related papers

Related papers: Curriculum Prompting Foundation Models for Medical…

200 papers

The Segment Anything Model (SAM) and similar models build a family of promptable foundation models (FMs) for image and video segmentation. The object of interest is identified using prompts, such as bounding boxes or points. With these FMs…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Caroline Magg , Hoel Kervadec , Clara I. Sánchez

The Medical Segment Anything Model (MedSAM) has shown remarkable performance in medical image segmentation, drawing significant attention in the field. However, its sensitivity to varying prompt types and locations poses challenges. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Nan Zhou , Ke Zou , Kai Ren , Mengting Luo , Linchao He , Meng Wang , Yidi Chen , Yi Zhang , Hu Chen , Huazhu Fu

This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Junyang Wu , Xianhang Li , Chen Wei , Huiyu Wang , Alan Yuille , Yuyin Zhou , Cihang Xie

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Pre-trained segmentation models are a powerful and flexible tool for segmenting images. Recently, this trend has extended to medical imaging. Yet, often these methods only produce a single prediction for a given image, neglecting inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Benjamin Towle , Xin Chen , Ke Zhou

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

The field of medical image segmentation is hindered by the scarcity of large, publicly available annotated datasets. Not all datasets are made public for privacy reasons, and creating annotations for a large dataset is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Iira Häkkinen , Iaroslav Melekhov , Erik Englesson , Hossein Azizpour , Juho Kannala

Medical image segmentation often faces the challenge of prohibitively expensive annotation costs. While few-shot learning offers a promising solution to alleviate this burden, conventional approaches still rely heavily on pre-training with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jie Xu , Xiaokang Li , Chengyu Yue , Yuanyuan Wang , Yi Guo

In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Saiyang Na , Yuzhi Guo , Feng Jiang , Hehuan Ma , Junzhou Huang

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

Interactive medical image segmentation refers to the accurate segmentation of the target of interest through interaction (e.g., click) between the user and the image. It has been widely studied in recent years as it is less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ao Chang , Xing Tao , Xin Yang , Yuhao Huang , Xinrui Zhou , Jiajun Zeng , Ruobing Huang , Dong Ni

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Huanli Zhuo , Leilei Ma , Haifeng Zhao , Shiwei Zhou , Dengdi Sun , Yanping Fu

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Automated segmentation of cancer on medical images can aid targeted diagnostic and therapeutic procedures. However, its adoption is limited by the high cost of expert annotations required for training and inter-observer variability in…

Image and Video Processing · Electrical Eng. & Systems 2025-05-26 Lynn Karam , Yipei Wang , Veeru Kasivisvanathan , Mirabela Rusu , Yipeng Hu , Shaheer U. Saeed

Spine image segmentation is crucial for clinical diagnosis and treatment of spine diseases. The complex structure of the spine and the high morphological similarity between individual vertebrae and adjacent intervertebral discs make…

Image and Video Processing · Electrical Eng. & Systems 2025-08-27 Dingwei Fan , Junyong Zhao , Chunlin Li , Mingliang Wang , Qi Zhu , Haipeng Si , Daoqiang Zhang , Liang Sun

The realm of computer vision has witnessed a paradigm shift with the advent of foundational models, mirroring the transformative influence of large language models in the domain of natural language processing. This paper delves into the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Lv Tang , Peng-Tao Jiang , Hao-Ke Xiao , Bo Li

A single biomedical image can be meaningfully segmented in multiple ways, depending on the desired application. For instance, a brain MRI can be segmented according to tissue types, vascular territories, broad anatomical regions,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Marianne Rakic , Siyu Gai , Etienne Chollet , John V. Guttag , Adrian V. Dalca

This paper aims to build a model that can Segment Anything in 3D medical images, driven by medical terminologies as Text prompts, termed as SAT. Our main contributions are three-fold: (i) We construct the first multimodal knowledge tree on…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Ziheng Zhao , Yao Zhang , Chaoyi Wu , Xiaoman Zhang , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie

Medical image segmentation is crucial for clinical diagnosis. The Segmentation Anything Model (SAM) serves as a powerful foundation model for visual segmentation and can be adapted for medical image segmentation. However, medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yuxi Liu , Guibo Luo , Yuesheng Zhu

Medical image segmentation is a fundamental task for medical image analysis and surgical planning. In recent years, UNet-based networks have prevailed in the field of medical image segmentation. However, convolution-neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xin You , Junjun He , Jie Yang , Yun Gu