English
Related papers

Related papers: Vision Foundation Models in Medical Image Analysis…

200 papers

Recent studies have indicated that foundation models, such as BERT and GPT, excel in adapting to a variety of downstream tasks. This adaptability has established them as the dominant force in building artificial intelligence (AI) systems.…

Machine Learning · Computer Science 2023-10-10 Weikai Yang , Mengchen Liu , Zheng Wang , Shixia Liu

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Image segmentation foundation models (SFMs) like Segment Anything Model (SAM) have achieved impressive zero-shot and interactive segmentation across diverse domains. However, they struggle to segment objects with certain structures,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yixin Zhang , Nicholas Konz , Kevin Kramer , Maciej A. Mazurowski

Vision Foundation Models (VFMs) are large-scale, pre-trained models that serve as general-purpose backbones for various computer vision tasks. As VFMs' popularity grows, there is an increasing interest in understanding their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Volodymyr Havrylov , Haiwen Huang , Dan Zhang , Andreas Geiger

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

The rise of large foundation models, trained on extensive datasets, is revolutionizing the field of AI. Models such as SAM, DALL-E2, and GPT-4 showcase their adaptability by extracting intricate patterns and performing effectively across…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xu Yan , Haiming Zhang , Yingjie Cai , Jingming Guo , Weichao Qiu , Bin Gao , Kaiqiang Zhou , Yue Zhao , Huan Jin , Jiantao Gao , Zhen Li , Lihui Jiang , Wei Zhang , Hongbo Zhang , Dengxin Dai , Bingbing Liu

Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this paper, we examine the…

The landscape of publicly available vision foundation models (VFMs), such as CLIP and Segment Anything Model (SAM), is expanding rapidly. VFMs are endowed with distinct capabilities stemming from their pre-training objectives. For instance,…

This paper addresses the domain adaptation challenge for semantic segmentation in medical imaging. Despite the impressive performance of recent foundational segmentation models like SAM on natural images, they struggle with medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Javier Gamazo Tejero , Moritz Schmid , Pablo Márquez Neila , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman

Segmenting 3D blood vessels is a critical yet challenging task in medical image analysis. This is due to significant imaging modality-specific variations in artifacts, vascular patterns and scales, signal-to-noise ratios, and background…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Bastian Wittmann , Yannick Wattenberg , Tamaz Amiranashvili , Suprosanna Shit , Bjoern Menze

Machine learning in medical imaging often faces a fundamental dilemma, namely, the small sample size problem. Many recent studies suggest using multi-domain data pooled from different acquisition sites/centers to improve statistical power.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hao Guan , Pew-Thian Yap , Andrea Bozoki , Mingxia Liu

Vision foundation models (VFMs) have demonstrated remarkable performance across a wide range of downstream tasks. While several VFM adapters have shown promising results by leveraging the prior knowledge of VFMs, we identify two…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yifan Li , Xin Li , Tianqin Li , Wenbin He , Yu Kong , Liu Ren

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Despite significant advances in deep learning for image and video segmentation, existing models continue to face challenges in cross-domain adaptability and generalization. Image and video segmentation are fundamental tasks in computer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhang Jiaxing , Tang Hao

Medical image segmentation is a critical aspect of modern medical research and clinical practice. Despite the remarkable performance of Convolutional Neural Networks (CNNs) in this domain, they inherently struggle to capture long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Jiashu Xu

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

Medical imaging plays a critical role in the diagnosis and treatment planning of various medical conditions, with radiology and pathology heavily reliant on precise image segmentation. The Segment Anything Model (SAM) has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Amin Ranem , Niklas Babendererde , Moritz Fuchs , Anirban Mukhopadhyay

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

Medical image segmentation allows quantifying target structure size and shape, aiding in disease diagnosis, prognosis, surgery planning, and comprehension.Building upon recent advancements in foundation Vision-Language Models (VLMs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Kanchan Poudel , Manish Dhakal , Prasiddha Bhandari , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal

Accurate segmentation of organs and lesions in medical images is essential for clinical applications including diagnosis, prognosis, and treatment planning. While Vision Transformers (ViTs) have shown impressive segmentation performance,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Jin Yang , Xiaobing Yu , Peijie Qiu