English
Related papers

Related papers: Do Vision Foundation Models Enhance Domain General…

200 papers

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

Pretraining with large-scale 3D volumes has a potential for improving the segmentation performance on a target medical image dataset where the training images and annotations are limited. Due to the high cost of acquiring pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Guotai Wang , Jianghao Wu , Xiangde Luo , Xinglong Liu , Kang Li , Shaoting Zhang

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shreyank N Gowda , David A. Clifton

Robotic perception in unstructured environments remains challenging despite the zero-shot capabilities of foundation models such as SAM. This work attributes performance degradation to non-uniform representation shifts across transformer…

Robotics · Computer Science 2026-05-26 Wenhui Chu

Accurate segmentation of the left atrium (LA) from late gadolinium-enhanced magnetic resonance imaging plays a vital role in visualizing diseased atrial structures, enabling the diagnosis and management of cardiovascular diseases. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Bipasha Kundu , Zixin Yang , Richard Simon , Cristian Linte

Medical image segmentation is crucial for accurate clinical diagnoses, yet it faces challenges such as low contrast between lesions and normal tissues, unclear boundaries, and high variability across patients. Deep learning has improved…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Houze Liu , Tong Zhou , Yanlin Xiang , Aoran Shen , Jiacheng Hu , Junliang Du

The advent of large-scale vision foundation models, pre-trained on diverse natural images, has marked a paradigm shift in computer vision. However, how the frontier vision foundation models' efficacies transfer to specialised domains such…

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data…

Quantitative Methods · Quantitative Biology 2026-04-23 Amgad Muneer , Kai Zhang , Ibraheem Hamdi , Rizwan Qureshi , Muhammad Waqas , Shereen Fouad , Hazrat Ali , Syed Muhammad Anwar , Jia Wu

Foundation models have revolutionized computational pathology by achieving remarkable success in high-level diagnostic tasks, yet the critical challenge of low-level image enhancement remains largely unaddressed. Real-world pathology images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ziyi Liu , Zhe Xu , Jiabo Ma , Wenqaing Li , Junlin Hou , Fuxiang Huang , Xi Wang , Ronald Cheong Kin Chan , Terence Tsz Wai Wong , Hao Chen

Medical image artificial intelligence models often achieve strong performance in single-center or single-device settings, yet their effectiveness frequently deteriorates in real-world cross-center deployment due to domain shift, limiting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jingsong Xia , Siqi Wang

Vision Foundation Models(VFMs) have achieved remarkable success in various computer vision tasks. However, their application to semantic segmentation is hindered by two significant challenges: (1) the disparity in data scale, as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhixiang Wei , Xiaoxiao Ma , Ruishen Yan , Tao Tu , Huaian Chen , Jinjin Zheng , Yi Jin , Enhong Chen

The rapid development of Vision Foundation Model (VFM) brings inherent out-domain generalization for a variety of down-stream tasks. Among them, domain generalized semantic segmentation (DGSS) holds unique challenges as the cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jingjun Yi , Qi Bi , Hao Zheng , Haolan Zhan , Wei Ji , Yawen Huang , Yuexiang Li , Yefeng Zheng

Fine-grained remote sensing image segmentation is essential for accurately identifying detailed objects in remote sensing images. Recently, vision transformer models (VTMs) pre-trained on large-scale datasets have demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Shun Zhang , Xuechao Zou , Kai Li , Congyan Lang , Shiying Wang , Pin Tao , Tengfei Cao

Medical foundation models, pre-trained with large-scale clinical data, demonstrate strong performance in diverse clinically relevant applications. RETFound, trained on nearly one million retinal images, exemplifies this approach in…

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Convolutional neural networks (CNNs) have shown promising results on several segmentation tasks in magnetic resonance (MR) images. However, the accuracy of CNNs may degrade severely when segmenting images acquired with different scanners…

Machine Learning · Statistics 2018-05-28 Neerav Karani , Krishna Chaitanya , Christian Baumgartner , Ender Konukoglu

Pathology foundation models (PFMs) have become central to computational pathology, aiming to offer general encoders for feature extraction from whole-slide images (WSIs). Despite strong benchmark performance, PFM robustness to real-world…

Image and Video Processing · Electrical Eng. & Systems 2026-01-08 Erik Thiringer , Fredrik K. Gustafsson , Kajsa Ledesma Eriksson , Mattias Rantalainen

Generalization capabilities of learning-based medical image segmentation across domains are currently limited by the performance degradation caused by the domain shift, particularly for ultrasound (US) imaging. The quality of US images…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Yuan Bi , Zhongliang Jiang , Ricarda Clarenbach , Reza Ghotbi , Angelos Karlas , Nassir Navab