English
Related papers

Related papers: MedForge: Building Medical Foundation Models Like …

200 papers

We introduce SoftTiger, a clinical large language model (CLaM) designed as a foundation model for healthcare workflows. The narrative and unstructured nature of clinical notes is a major obstacle for healthcare intelligentization. We…

Computation and Language · Computer Science 2024-08-21 Ye Chen , Igor Couto , Wei Cai , Cong Fu , Bruno Dorneles

Recent advancements in multimodal machine learning have empowered the development of accurate and robust AI systems in the medical domain, especially within centralized database systems. Simultaneously, Federated Learning (FL) has…

Privacy data protection in the medical field poses challenges to data sharing, limiting the ability to integrate data across hospitals for training high-precision auxiliary diagnostic models. Traditional centralized training methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Tian Bowen , Xu Zhengyang , Yin Zhihao , Wang Jingying , Yue Yutao

Federated learning (FL) is an active area of research. One of the most suitable areas for adopting FL is the medical domain, where patient privacy must be respected. Previous research, however, does not provide a practical guide to applying…

Machine Learning · Computer Science 2023-05-22 Seongjun Yang , Hyeonji Hwang , Daeyoung Kim , Radhika Dua , Jong-Yeup Kim , Eunho Yang , Edward Choi

The emerging trend of advancing generalist artificial intelligence, such as GPTv4 and Gemini, has reshaped the landscape of research (academia and industry) in machine learning and many other research areas. However, domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xiaosong Wang , Xiaofan Zhang , Guotai Wang , Junjun He , Zhongyu Li , Wentao Zhu , Yi Guo , Qi Dou , Xiaoxiao Li , Dequan Wang , Liang Hong , Qicheng Lao , Tong Ruan , Yukun Zhou , Yixue Li , Jie Zhao , Kang Li , Xin Sun , Lifeng Zhu , Shaoting Zhang

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Federated Learning (FL), a privacy-preserving machine learning framework, faces significant data-related challenges. For example, the lack of suitable public datasets leads to ineffective information exchange, especially in heterogeneous…

Cryptography and Security · Computer Science 2025-04-22 Xi Li , Chen Wu , Jiaqi Wang

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Driven by the recent advances in deep learning methods and, in particular, by the development of modern self-supervised learning algorithms, increased interest and efforts have been devoted to build foundation models (FMs) for medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 kaiko. ai , Nanne Aben , Edwin D. de Jong , Ioannis Gatopoulos , Nicolas Känzig , Mikhail Karasikov , Axel Lagré , Roman Moser , Joost van Doorn , Fei Tang

Federated learning (FL) allows participants to collaboratively train machine learning models while keeping their data local, making it ideal for collaborations among healthcare institutions on sensitive data. However, in this paper, we…

Federated learning (FL) has been widely adopted across various applications, such as healthcare, finance, and smart cities. However, as experimental scenarios become more complex, existing FL frameworks and benchmarks have struggled to keep…

Machine Learning · Computer Science 2024-09-10 Chuyi Chen , Zhe Zhang , Yanchao Zhao

Federated learning (FL) has found numerous applications in healthcare, finance, and IoT scenarios. Many existing FL frameworks offer a range of benchmarks to evaluate the performance of FL under realistic conditions. However, the process of…

Machine Learning · Computer Science 2023-06-22 Zheng Wang , Xiaoliang Fan , Zhaopeng Peng , Xueheng Li , Ziqi Yang , Mingkuan Feng , Zhicheng Yang , Xiao Liu , Cheng Wang

Foundation models update slowly due to resource-intensive training, whereas domain-specific models evolve rapidly between releases. Model merging seeks to combine multiple expert models into a single, more capable model, reducing storage…

Artificial Intelligence · Computer Science 2026-03-04 Yongxian Wei , Runxi Cheng , Weike Jin , Enneng Yang , Li Shen , Lu Hou , Sinan Du , Chun Yuan , Xiaochun Cao , Dacheng Tao

As the rapid development of computer vision and the emergence of powerful network backbones and architectures, the application of deep learning in medical imaging has become increasingly significant. Unlike natural images, medical images…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Guoqing Zhang , Jingyun Yang , Yang Li

Although data-driven methods usually have noticeable performance on disease diagnosis and treatment, they are suspected of leakage of privacy due to collecting data for model training. Recently, federated learning provides a secure and…

Artificial Intelligence · Computer Science 2023-06-27 Yawei Zhao , Qinghe Liu , Xinwang Liu , Kunlun He

Multimodal AI has demonstrated superior performance over unimodal approaches by leveraging diverse data sources for more comprehensive analysis. However, applying this effectiveness in healthcare is challenging due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Pranav Poudel , Prashant Shrestha , Sanskar Amgain , Yash Raj Shrestha , Prashnna Gyawali , Binod Bhattarai

The combination of electronic health records (EHR) and medical images is crucial for clinicians in making diagnoses and forecasting prognosis. Strategically fusing these two data modalities has great potential to improve the accuracy of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Wenfang Yao , Kejing Yin , William K. Cheung , Jia Liu , Jing Qin

Foundation models (FMs) have demonstrated strong transferability across medical imaging tasks, yet their clinical utility depends critically on how pretrained representations are adapted to domain-specific data, supervision regimes, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn