English
Related papers

Related papers: A data- and compute-efficient chest X-ray foundati…

200 papers

Multi-sequence Magnetic Resonance Imaging (MRI) offers remarkable versatility, enabling the distinct visualization of different tissue types. Nevertheless, the inherent heterogeneity among MRI sequences poses significant challenges to the…

Latent Diffusion Models have shown remarkable results in text-guided image synthesis in recent years. In the domain of natural (RGB) images, recent works have shown that such models can be adapted to various vision-language downstream tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Konstantinos Vilouras , Ilias Stogiannidis , Junyu Yan , Alison Q. O'Neil , Sotirios A. Tsaftaris

Deep learning nowadays offers expert-level and sometimes even super-expert-level performance, but achieving such performance demands massive annotated data for training (e.g., Google's proprietary CXR Foundation Model (CXR-FM) was trained…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 DongAo Ma , Jiaxuan Pang , Michael B. Gotway , Jianming Liang

Recently large vision-language models have shown potential when interpreting complex images and generating natural language descriptions using advanced reasoning. Medicine's inherently multimodal nature incorporating scans and text-based…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Naman Sharma

Chest X-Ray (CXR) is a widely used clinical imaging modality and has a pivotal role in the diagnosis and prognosis of various lung and heart related conditions. Conventional automated clinical diagnostic tool design strategies relying on…

Image and Video Processing · Electrical Eng. & Systems 2024-07-26 Abhijeet Parida , Daniel Capellan-Martin , Sara Atito , Muhammad Awais , Maria J. Ledesma-Carbayo , Marius G. Linguraru , Syed Muhammad Anwar

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

The imperative for early detection of type 2 diabetes mellitus (T2DM) is challenged by its asymptomatic onset and dependence on suboptimal clinical diagnostic tests, contributing to its widespread global prevalence. While research into…

Machine Learning · Computer Science 2024-12-17 Sanjana Gundapaneni , Zhuo Zhi , Miguel Rodrigues

Foundation models have revolutionized computer vision by achieving vastly superior performance across diverse tasks through large-scale pretraining on extensive datasets. However, their application in surgical computer vision has been…

The availability of large public datasets and the increased amount of computing power have shifted the interest of the medical community to high-performance algorithms. However, little attention is paid to the quality of the data and their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Amelia Jiménez-Sánchez , Dovile Juodelyte , Bethany Chamberlain , Veronika Cheplygina

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Despite recent progress, medical foundation models still struggle to unify visual understanding and generation, as these tasks have inherently conflicting goals: semantic abstraction versus pixel-level reconstruction. Existing approaches,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Ruiheng Zhang , Jingfeng Yao , Huangxuan Zhao , Hao Yan , Xiao He , Lei Chen , Zhou Wei , Yong Luo , Zengmao Wang , Lefei Zhang , Dacheng Tao , Bo Du

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Multimodal chest X-Ray analysis often fine-tunes large vision-language models, which is computationally costly. We study parameter-efficient training (PET) strategies, including frozen encoders, BitFit, LoRA, and adapters for multi-label…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Md Ashik Khan , Md Nahid Siddique

The interpretation of Chest X-ray is an important diagnostic issue in clinical practice and especially in the resource-limited setting where the shortage of radiologists plays a role in delayed diagnosis and poor patient outcomes. Although…

Image and Video Processing · Electrical Eng. & Systems 2025-12-11 Ali M. Bahram , Saman Muhammad Omer , Hardi M. Mohammed , Sirwan Abdolwahed Aula

Foundation models are emerging as a powerful paradigm for fMRI analysis, but current approaches face a dual bottleneck of data- and training-efficiency. Atlas-based methods aggregate voxel signals into fixed regions of interest, reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Mo Wang , Junfeng Xia , Wenhao Ye , Enyu Liu , Kaining Peng , Jianfeng Feng , Quanying Liu , Hongkai Wen

Federated learning enables building a shared model from multicentre data while storing the training data locally for privacy. In this paper, we present an evaluation (called CXR-FL) of deep learning-based models for chest X-ray image…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Filip Ślazyk , Przemysław Jabłecki , Aneta Lisowska , Maciej Malawski , Szymon Płotka

Foundation models, pre-trained on massive datasets, have achieved unprecedented generalizability. However, is it truly necessary to involve such vast amounts of data in pre-training, consuming extensive computational resources? This paper…

Machine Learning · Computer Science 2024-08-19 Wenxuan Yang , Weimin Tan , Yuqi Sun , Bo Yan

The development of foundation models for brain MRI depends critically on the scale, diversity, and consistency of available data, yet systematic assessments of these factors remain scarce. In this study, we analyze 54 publicly accessible…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Minh Sao Khue Luu , Margaret V. Benedichuk , Ekaterina I. Roppert , Roman M. Kenzhin , Bair N. Tuchinov

Computed tomography (CT) is a central to three-dimensional medical imaging, yet CT-based artificial intelligence remains fragmented across task-specific models for segmentation, classification, registration, and report analysis. Here we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yuheng Li , Yuan Gao , Haoyu Dong , Yuxiang Lai , Shansong Wang , Mojtaba Safari , James E. Baciak , Xiaofeng Yang