English
Related papers

Related papers: MedGemma Technical Report

200 papers

The development of 3D medical vision-language models holds significant potential for disease diagnosis and patient treatment. However, compared to 2D medical images, 3D medical images, such as CT scans, face challenges related to limited…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Weifu Lv , S. Kevin Zhou

Retrieval-Augmented Generation systems are essential for providing fact-based guidance from Malaysian Clinical Practice Guidelines. However, their effectiveness with image-based queries is limited, as general Vision-Language Model captions…

Computation and Language · Computer Science 2025-11-10 Lee Qi Zun , Mohamad Zulhilmi Bin Abdul Halim , Goh Man Fye

Recent advancements in Large Language Models (LLMs) and Large Vision Language Models (LVLMs) have enabled general-purpose systems to demonstrate promising capabilities in complex reasoning tasks, including those in the medical domain.…

Computation and Language · Computer Science 2026-05-19 Rafid Ahmed , Intesar Tahmid , Mir Sazzat Hossain , Tasnimul Hossain Tomal , Md Fahim , Md Farhad Alam Bhuiyan

Medicine is inherently multimodal and multitask, with diverse data modalities spanning text, imaging. However, most models in medical field are unimodal single tasks and lack good generalizability and explainability. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Lijian Xu , Hao Sun , Ziyu Ni , Hongsheng Li , Shaoting Zhang

Generalist foundation model has ushered in newfound capabilities in medical domain. However, the contradiction between the growing demand for high-quality annotated data with patient privacy continues to intensify. The utilization of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hao Wei , Bowen Liu , Minqing Zhang , Peilun Shi , Wu Yuan

Med42-v2 introduces a suite of clinical large language models (LLMs) designed to address the limitations of generic models in healthcare settings. These models are built on Llama3 architecture and fine-tuned using specialized clinical data.…

Computation and Language · Computer Science 2024-08-13 Clément Christophe , Praveen K Kanithi , Tathagata Raha , Shadab Khan , Marco AF Pimentel

The adoption of visual foundation models has become a common practice in computer-aided diagnosis (CAD). While these foundation models provide a viable solution for creating generalist medical AI, privacy concerns make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yitao Zhu , Yuan Yin , Jiaming Li , Mengjie Xu , Zihao Zhao , Honglin Xiong , Sheng Wang , Qian Wang

Artificial intelligence (AI) is showing promise in improving clinical diagnosis. In breast cancer screening, recent studies show that AI has the potential to improve early cancer diagnosis and reduce unnecessary workup. As the number of…

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradigm shifts. This survey provides an extensive review of recent advancements in Medical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Beria Chingnabe Kalpelbe , Angel Gabriel Adaambiik , Wei Peng

Dermatological care via telemedicine often lacks the rich context of in-person visits. Clinicians must make diagnoses based on a handful of images and brief descriptions, without the benefit of physical exams, second opinions, or reference…

Artificial Intelligence · Computer Science 2025-08-27 Karishma Thakrar , Shreyas Basavatia , Akshay Daftardar

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

Machine Learning · Computer Science 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

Medical vision-language pretraining (VLP) that leverages naturally-paired medical image-report data is crucial for medical image analysis. However, existing methods struggle to accurately characterize associations between images and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xinjie Liang , Xiangyu Li , Fanding Li , Jie Jiang , Qing Dong , Wei Wang , Kuanquan Wang , Suyu Dong , Gongning Luo , Shuo Li

Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Zelong Liu , Andrew Tieu , Nikhil Patel , Georgios Soultanidis , Louisa Deyer , Ying Wang , Sean Huver , Alexander Zhou , Yunhao Mei , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Artificial intelligence has demonstrated significant potential in clinical decision-making; however, developing models capable of adapting to diverse real-world scenarios and performing complex diagnostic reasoning remains a major…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Ronghao Xu , Zhen Huang , Yangbo Wei , Xiaoqian Zhou , Zikang Xu , Ting Liu , Zihang Jiang , S. Kevin Zhou

Technological advances in artificial intelligence (AI) have enabled the development of large vision language models (LVLMs) that are trained on millions of paired image and text samples. Subsequent research efforts have demonstrated great…

Computation and Language · Computer Science 2024-11-28 Kalina P. Slavkova , Melanie Traughber , Oliver Chen , Robert Bakos , Shayna Goldstein , Dan Harms , Bradley J. Erickson , Khan M. Siddiqui

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Recent advances in medical vision-language models (VLMs) open up remarkable opportunities for clinical applications such as automated report generation, copilots for physicians, and uncertainty quantification. However, despite their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Xiao Li , Yanfan Zhu , Ruining Deng , Wei-Qi Wei , Yu Wang , Shilin Zhao , Yaohong Wang , Haichun Yang , Yuankai Huo

Biomedical multimodal assistants have the potential to unify radiology, pathology, and clinical-text reasoning, yet a critical deployment gap remains: top-performing systems are either closed-source or computationally prohibitive,…

Computation and Language · Computer Science 2026-03-03 Kai Zhang , Zhengqing Yuan , Cheng Peng , Songlin Zhao , Mengxian Lyu , Ziyi Chen , Yanfang Ye , Wei Liu , Ying Zhang , Kaleb E Smith , Lifang He , Lichao Sun , Yonghui Wu

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu