English
Related papers

Related papers: Towards Generalist Biomedical AI

200 papers

Multimodal large language models (MLLMs) hold significant potential in medical applications, including disease diagnosis and clinical decision-making. However, these tasks require highly accurate, context-sensitive, and professionally…

Computation and Language · Computer Science 2025-09-01 Meidan Ding , Jipeng Zhang , Wenxuan Wang , Cheng-Yi Li , Wei-Chieh Fang , Hsin-Yu Wu , Haiqin Zhong , Wenting Chen , Linlin Shen

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

The pursuit of artificial general intelligence (AGI) has been accelerated by Multimodal Large Language Models (MLLMs), which exhibit superior reasoning, generalization capabilities, and proficiency in processing multimodal inputs. A crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yi Chen , Yuying Ge , Yixiao Ge , Mingyu Ding , Bohao Li , Rui Wang , Ruifeng Xu , Ying Shan , Xihui Liu

Multi-modal large language models (MLLMs) have shown impressive capabilities as a general-purpose interface for various visual and linguistic tasks. However, building a unified MLLM for multi-task learning in the medical field remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xun Zhu , Ying Hu , Fanbin Mo , Miao Li , Ji Wu

Recent advances in multimodal large language models have enabled unified processing of visual and textual inputs, offering promising applications in general-purpose medical AI. However, their ability to generalize compositionally across…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Pooja Singh , Siddhant Ujjain , Tapan Kumar Gandhi , Sandeep Kumar

Despite the excitement behind biomedical artificial intelligence (AI), access to high-quality, diverse, and large-scale data - the foundation for modern AI systems - is still a bottleneck to unlocking its full potential. To address this…

Foundation large language models (LLMs) have shown an impressive ability to solve tasks across a wide range of fields including health. To effectively solve personalized health tasks, LLMs need the ability to ingest a diversity of data…

Foundation models (FMs) have shown great promise in medical imaging, but most FMs are trained on unimodal data within isolated domains, such as brain MRI alone. Human aging and disease arise through coordinated biological processes across…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Qiangqiang Wu , Grace McIlvain , Zhou Yu , Junhao Wen

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…

Medicine, by its nature, is a multifaceted domain that requires the synthesis of information across various modalities. Medical generative vision-language models (VLMs) make a first step in this direction and promise many exciting clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Michael Moor , Qian Huang , Shirley Wu , Michihiro Yasunaga , Cyril Zakka , Yash Dalmia , Eduardo Pontes Reis , Pranav Rajpurkar , Jure Leskovec

Multimodal Large Language Models (MLLMs) show promise in gastroenterology, yet their performance against comprehensive clinical workflows and human benchmarks remains unverified. To systematically evaluate state-of-the-art MLLMs across a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yan Zhu , Te Luo , Pei-Yao Fu , Zhen Zhang , Zi-Long Wang , Yi-Fan Qu , Zi-Han Geng , Jia-Qi Xu , Lu Yao , Li-Yun Ma , Wei Su , Wei-Feng Chen , Quan-Lin Li , Shuo Wang , Ping-Hong Zhou

Medical artificial intelligence (AI) systems, particularly multimodal vision-language models (VLM), often exhibit intersectional biases where models are systematically less confident in diagnosing marginalised patient subgroups. Such bias…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yupeng Zhang , Adam G. Dunn , Usman Naseem , Jinman Kim

Explainable artificial intelligence (XAI) has become increasingly important in biomedical image analysis to promote transparency, trust, and clinical adoption of DL models. While several surveys have reviewed XAI techniques, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Getamesay Haile Dagnaw , Yanming Zhu , Muhammad Hassan Maqsood , Wencheng Yang , Xingshuai Dong , Xuefei Yin , Alan Wee-Chung Liew

Medical artificial intelligence (AI) is revolutionizing the interpretation of chest X-ray (CXR) images by providing robust tools for disease diagnosis. However, the effectiveness of these AI models is often limited by their reliance on…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Lijian Xu , Ziyu Ni , Hao Sun , Hongsheng Li , Shaoting Zhang

Artificial intelligence (AI) has the potential to transform medical imaging by automating image analysis and accelerating clinical research. However, research and clinical use are limited by the wide variety of AI implementations and…

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision…

Quantitative Methods · Quantitative Biology 2026-03-03 Ekaterina Redekop , Eric Zimmermann , Ava P Amini , Alex X Lu , Neil Tenenholtz , James Brian Hall , Lorin Crawford , Kristen A Severson

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such…

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiaxing Huang , Jingyi Zhang

Oral and maxillofacial radiology plays a vital role in dental healthcare, but radiographic image interpretation is limited by a shortage of trained professionals. While AI approaches have shown promise, existing dental AI systems are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Xinrui Huang , Fan Xiao , Dongming He , Anqi Gao , Dandan Li , Xiaofan Zhang , Shaoting Zhang , Xudong Wang