English
Related papers

Related papers: OpenMEDLab: An Open-source Platform for Multi-moda…

200 papers

Developing generalizable AI for medical imaging requires both access to large, multi-center datasets and standardized, reproducible tooling within research environments. However, leveraging real-world imaging data in clinical research…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Ünal Akünal , Markus Bujotzek , Stefan Denner , Benjamin Hamm , Klaus Kades , Philipp Schader , Jonas Scherer , Marco Nolden , Peter Neher , Ralf Floca , Klaus Maier-Hein

The advancement of artificial intelligence (AI) hinges on the quality and accessibility of data, yet the current fragmentation and variability of data sources hinder efficient data utilization. The dispersion of data sources and diversity…

Digital Libraries · Computer Science 2024-07-22 Conghui He , Wei Li , Zhenjiang Jin , Chao Xu , Bin Wang , Dahua Lin

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source…

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Current medical AI systems are often limited to narrow applications, hindering widespread adoption. We present MedVersa, a generalist foundation model trained on tens of millions of compiled medical instances. MedVersa unlocks generalist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Hong-Yu Zhou , Julián Nicolás Acosta , Subathra Adithan , Suvrankar Datta , Eric J. Topol , Pranav Rajpurkar

This position paper analyzes the evolving roles of open-source and closed-source large language models (LLMs) in healthcare, emphasizing their distinct contributions and the scientific community's response to their development. Due to their…

Computers and Society · Computer Science 2025-01-20 Jiawei Xu , Ying Ding , Yi Bu

In this paper, we present OpenMedIA, an open-source toolbox library containing a rich set of deep learning methods for medical image analysis under heterogeneous Artificial Intelligence (AI) computing platforms. Various medical image…

Image and Video Processing · Electrical Eng. & Systems 2022-09-09 Jia-Xin Zhuang , Xiansong Huang , Yang Yang , Jiancong Chen , Yue Yu , Wei Gao , Ge Li , Jie Chen , Tong Zhang

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradigm shifts. This survey provides an extensive review of recent advancements in Medical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Beria Chingnabe Kalpelbe , Angel Gabriel Adaambiik , Wei Peng

We introduce MultiMedEval, an open-source toolkit for fair and reproducible evaluation of large, medical vision-language models (VLM). MultiMedEval comprehensively assesses the models' performance on a broad array of six multi-modal tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Corentin Royer , Bjoern Menze , Anjany Sekuboyina

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

With advanced imaging, sequencing, and profiling technologies, multiple omics data become increasingly available and hold promises for many healthcare applications such as cancer diagnosis and treatment. Multimodal learning for integrative…

Genomics · Quantitative Biology 2022-12-20 Sina Tabakhi , Mohammod Naimul Islam Suvon , Pegah Ahadian , Haiping Lu

The adoption of visual foundation models has become a common practice in computer-aided diagnosis (CAD). While these foundation models provide a viable solution for creating generalist medical AI, privacy concerns make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yitao Zhu , Yuan Yin , Jiaming Li , Mengjie Xu , Zihao Zhao , Honglin Xiong , Sheng Wang , Qian Wang

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of…

Machine Learning · Computer Science 2024-01-23 Elisa Warner , Joonsang Lee , William Hsu , Tanveer Syeda-Mahmood , Charles Kahn , Olivier Gevaert , Arvind Rao

Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Xuanru Zhou , Cheng Li , Shuqiang Wang , Ye Li , Tao Tan , Hairong Zheng , Shanshan Wang

Multi-modal Large Language Models (MLLMs) have shown impressive abilities in generating reasonable responses with respect to multi-modal contents. However, there is still a wide gap between the performance of recent MLLM-based applications…

The impressive performance of generalist large language models (LLMs) such as GPT and Claude in healthcare raises a critical question: will domain-specific medical specialist models become obsolete? We argue that the future of medical…

Artificial Intelligence · Computer Science 2026-05-29 Yanan Wang , Shuaicong Hu , Jian Liu , Guohui Zhou , Aiguo Wang , Cuiwei Yang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn