English
Related papers

Related papers: Vision Foundation Models in Medical Image Analysis…

200 papers

Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision. While considerable efforts have been dedicated to establishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Fereshteh Shakeri , Yunshi Huang , Julio Silva-Rodríguez , Houda Bahig , An Tang , Jose Dolz , Ismail Ben Ayed

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Huanli Zhuo , Leilei Ma , Haifeng Zhao , Shiwei Zhou , Dengdi Sun , Yanping Fu

Vision foundation models (VFMs) are predominantly developed using data-centric methods. These methods require training on vast amounts of data usually with high-quality labels, which poses a bottleneck for most institutions that lack both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jiabo Huang , Chen Chen , Lingjuan Lyu

In medical image analysis, the expertise scarcity and the high cost of data annotation limits the development of large artificial intelligence models. This paper investigates the potential of transfer learning with pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiajin Zhang , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

This work presents the first attempt to repurpose vision foundation models (VFMs) as image codecs, aiming to explore their generation capability for low-rate image compression. VFMs are widely employed in both conditional and unconditional…

Image and Video Processing · Electrical Eng. & Systems 2025-09-08 Huu-Tai Phung , Yu-Hsiang Lin , Yen-Kuan Ho , Wen-Hsiao Peng

Accurate medical image segmentation is essential for clinical diagnosis and treatment planning. While recent interactive foundation models (e.g., nnInteractive) enhance generalization through large-scale multimodal pretraining, they still…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ziyu Zhang , Yi Yu , Simeng Zhu , Ahmed Aly , Yunhe Gao , Ning Gu , Yuan Xue

Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degrades under realistic image corruptions such as noise, blur, motion artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jieru Li , Matthew Chen , Micky C. Nnamdi , J. Ben Tamo , Benoit L. Marteau , May D. Wang

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

Recently, foundation models have been introduced demonstrating various tasks in the field of computer vision. These models such as Segment Anything Model (SAM) are generalized models trained using huge datasets. Currently, ongoing research…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shurong Chai , Rahul Kumar Jain , Shiyu Teng , Jiaqing Liu , Yinhao Li , Tomoko Tateyama , Yen-wei Chen

Vision Foundation Models (VFMs) have demonstrated impressive representational capabilities. However, adapting them to downstream tasks via full fine-tuning incurs prohibitive computational and storage overhead. Parameter-Efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Lingyu Xiong , Jinjin Shi , Xuran Xu , Cong Luo , Runyu Shi , Ying Huang

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural images and videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Yichi Zhang , Zhenrong Shen

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

We propose a segmentation framework that uses deep neural networks and introduce two innovations. First, we describe a biophysics-based domain adaptation method. Second, we propose an automatic method to segment white and gray matter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Amir Gholami , Shashank Subramanian , Varun Shenoy , Naveen Himthani , Xiangyu Yue , Sicheng Zhao , Peter Jin , George Biros , Kurt Keutzer

3D medical image classification is essential for modern clinical workflows. Medical foundation models (FMs) have emerged as a promising approach for scaling to new tasks, yet current research suffers from three critical pitfalls:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Han Liu , Bogdan Georgescu , Yanbo Zhang , Youngjin Yoo , Michael Baumgartner , Riqiang Gao , Jianing Wang , Gengyan Zhao , Eli Gibson , Dorin Comaniciu , Sasa Grbic

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

Vision foundation models (VFMs) have demonstrated remarkable capabilities in learning universal visual representations. However, adapting these models to downstream tasks conventionally requires parameter updates, with even…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiahuan Long , Tingsong Jiang , Wen Yao , Yizhe Xiong , Zhengqin Xu , Shuai Jia , Hanqing Liu , Chao Ma

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

In the past decades, deep neural networks, particularly convolutional neural networks, have achieved state-of-the-art performance in a variety of medical image segmentation tasks. Recently, the introduction of the vision transformer (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Peijie Qiu , Jin Yang , Sayantan Kumar , Soumyendu Sekhar Ghosh , Aristeidis Sotiras

Despite the promise of foundation models in medical AI, current systems remain limited - they are modality-specific and lack transparent reasoning processes, hindering clinical adoption. To address this gap, we present EVLF-FM, a multimodal…