English
Related papers

Related papers: MedForge: Building Medical Foundation Models Like …

200 papers

Personalized medication aims to tailor healthcare to individual patient characteristics. However, the heterogeneity of patient data across healthcare systems presents significant challenges to achieving accurate and effective personalized…

Artificial Intelligence · Computer Science 2024-12-10 Jiechao Gao , Yuangang Li

Model merging has emerged as a crucial technique in Deep Learning, enabling the integration of multiple models into a unified system while preserving perfor-mance and scalability. In this respect, the compositional properties of low-rank…

Machine Learning · Computer Science 2025-03-11 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Jacopo Bonato , Luigi Sabetta , Simone Calderara

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

Machine Learning · Computer Science 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

Medical image segmentation is crucial for clinical diagnosis. The Segmentation Anything Model (SAM) serves as a powerful foundation model for visual segmentation and can be adapted for medical image segmentation. However, medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yuxi Liu , Guibo Luo , Yuesheng Zhu

Secure and interoperable integration of heterogeneous medical data remains a grand challenge in digital health. Current federated learning (FL) frameworks offer privacy-preserving model training but lack standardized mechanisms to…

Cryptography and Security · Computer Science 2025-10-03 Aueaphum Aueawatthanaphisut

The increasing use of 3D imaging technologies in biological sciences is generating vast repositories of anatomical data, yet significant barriers prevent this data from reaching its full potential in educational and collaborative contexts.…

Quantitative Methods · Quantitative Biology 2026-01-05 A. Murat Maga , Steve Pieper , Cassandra Donatelli , Paul M Gignac , Matthew Kolmann , Christopher Noto , Adam Summers , Natalie Taft

For healthcare datasets, it is often not possible to combine data samples from multiple sites due to ethical, privacy or logistical concerns. Federated learning allows for the utilisation of powerful machine learning algorithms without…

Foundation models have demonstrated remarkable capabilities in handling diverse modalities and tasks, outperforming conventional artificial intelligence (AI) approaches that are highly task-specific and modality-reliant. In the medical…

Machine Learning · Computer Science 2025-05-06 Xiaochen Wang , Jiaqi Wang , Houping Xiao , Jinghui Chen , Fenglong Ma

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

The intersection of Foundation Model (FM) and Federated Learning (FL) presents a unique opportunity to unlock new possibilities for real-world applications. On the one hand, FL, as a collaborative learning paradigm, help address challenges…

Machine Learning · Computer Science 2025-05-06 Weiming Zhuang , Chen Chen , Jingtao Li , Chaochao Chen , Yaochu Jin , Lingjuan Lyu

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Foundation models pre-trained on large-scale datasets demonstrate strong transfer learning capabilities; however, their adaptation to complex multi-label diagnostic tasks-such as comprehensive head CT finding detection-remains understudied.…

Generalist foundation models (GFMs) are renowned for their exceptional capability and flexibility in effectively generalizing across diverse tasks and modalities. In the field of medicine, while GFMs exhibit superior generalizability based…

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Large language models (LLMs) show great promise in healthcare, but their applications are hindered by data privacy restrictions and the challenges of cross-institution collaboration. Sensitive medical data cannot be centralized, while…

Computational Engineering, Finance, and Science · Computer Science 2025-10-02 Zeyu Chen , Yun Ji , Bowen Wang , Liwen Shi , Zijie Zeng , Sheng Zhang

Electronic health records (EHRs) are multimodal by nature, consisting of structured tabular features like lab tests and unstructured clinical notes. In real-life clinical practice, doctors use complementary multimodal EHR data sources to…

Computation and Language · Computer Science 2024-07-18 Thao Minh Nguyen Phan , Cong-Tinh Dao , Chenwei Wu , Jian-Zhe Wang , Shun Liu , Jun-En Ding , David Restrepo , Feng Liu , Fang-Ming Hung , Wen-Chih Peng

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data…

Quantitative Methods · Quantitative Biology 2026-04-23 Amgad Muneer , Kai Zhang , Ibraheem Hamdi , Rizwan Qureshi , Muhammad Waqas , Shereen Fouad , Hazrat Ali , Syed Muhammad Anwar , Jia Wu