English
Related papers

Related papers: Do Vision Foundation Models Enhance Domain General…

200 papers

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation models, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mohammed Baharoon , Waseem Qureshi , Jiahong Ouyang , Yanwu Xu , Abdulrhman Aljouie , Wei Peng

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang

We tackle the challenging problem of single-source domain generalization (DG) for medical image segmentation, where we train a network on one domain (e.g., CT) and directly apply it to a different domain (e.g., MR) without adapting the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Franz Thaler , Martin Urschler , Mateusz Kozinski , Matthias AF Gsell , Gernot Plank , Darko Stern

Foundation models (FMs) are large neural networks trained on broad datasets, excelling in downstream tasks with minimal fine-tuning. Human activity recognition in video has advanced with FMs, driven by competition among different…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Thinesh Thiyakesan Ponbagavathi , Kunyu Peng , Alina Roitberg

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Fine-tuning pre-trained neural network models has become a widely adopted approach across various domains. However, it can lead to the distortion of pre-trained feature extractors that already possess strong generalization capabilities.…

Machine Learning · Computer Science 2024-03-27 Seokhyeon Ha , Sunbeom Jung , Jungwoo Lee

Foundation models (FMs) have shown great promise in medical image analysis by improving generalization across diverse downstream tasks. In ophthalmology, several FMs have recently emerged, but there is still no clear answer to fundamental…

While the Segment Anything Model (SAM) has achieved remarkable success in image segmentation, its direct application to medical imaging remains hindered by fundamental challenges, including ambiguous boundaries, insufficient modeling of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yu Li , Da Chang , Xi Xiao

We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. However, geoscience faces…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Zhixiang Guo , Xinming Wu , Luming Liang , Hanlin Sheng , Nuo Chen , Zhengfa Bi

Foundation models (FMs), i.e., models trained on a vast amount of typically unlabeled data, have become popular and available recently for the domain of histopathology. The key idea is to extract semantically rich vectors from any input…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jonathan Ganz , Jonas Ammeling , Emely Rosbach , Ludwig Lausser , Christof A. Bertram , Katharina Breininger , Marc Aubreville

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

This paper addresses the domain adaptation challenge for semantic segmentation in medical imaging. Despite the impressive performance of recent foundational segmentation models like SAM on natural images, they struggle with medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Javier Gamazo Tejero , Moritz Schmid , Pablo Márquez Neila , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

Automatic segmentation of medical images is crucial in modern clinical workflows. The Segment Anything Model (SAM) has emerged as a versatile tool for image segmentation without specific domain training, but it requires human prompts and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Yunxiang Li , Bowen Jing , Zihan Li , Jing Wang , You Zhang

Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Sulaiman Vesal , Iani Gayo , Indrani Bhattacharya , Shyam Natarajan , Leonard S. Marks , Dean C Barratt , Richard E. Fan , Yipeng Hu , Geoffrey A. Sonn , Mirabela Rusu

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Walid Ehab , Yongmin Li

Machine learning algorithms have revolutionized different fields, including natural language processing, computer vision, signal processing, and medical data processing. Despite the excellent capabilities of machine learning algorithms in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Gita Sarafraz , Armin Behnamnia , Mehran Hosseinzadeh , Ali Balapour , Amin Meghrazi , Hamid R. Rabiee

Rapid advancements in medical image segmentation performance have been significantly driven by the development of Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). These models follow the discriminative pixel-wise…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Jiayu Huo , Xi Ouyang , Sébastien Ourselin , Rachel Sparks

Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degrades under realistic image corruptions such as noise, blur, motion artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jieru Li , Matthew Chen , Micky C. Nnamdi , J. Ben Tamo , Benoit L. Marteau , May D. Wang