English
Related papers

Related papers: Simulating Clinical AI Assistance using Multimodal…

200 papers

Accurate and interpretable multi-disease diagnosis remains a critical challenge in medical research, particularly when leveraging heterogeneous multimodal medical data. Current approaches often rely on single-modal data, limiting their…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Yuting Zhang , Kaishen Yuan , Hao Lu , Yutao Yue , Jintai Chen , Kaishun Wu

Diabetic retinopathy (DR) results in vision loss if not treated early. A computer-aided diagnosis (CAD) system based on retinal fundus images is an efficient and effective method for early DR diagnosis and assisting experts. A…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Norah Asiri , Muhammad Hussain , Fadwa Al Adel , Nazih Alzaidi

Large multimodal models (LMMs) have demonstrated significant potential in providing innovative solutions for various biomedical tasks, including pathology analysis, radiology report generation, and biomedical assistance. However, the…

Machine Learning · Computer Science 2025-12-30 Dong Xue , Ziyao Shao , Zhaoyang Duan , Fangzhou Liu , Bing Li , Zhongheng Zhang

Medical decision-support and advising systems are critical for emergency physicians to quickly and accurately assess patients' conditions and make diagnosis. Artificial Intelligence (AI) has emerged as a transformative force in healthcare…

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where…

In recent years, the focus is on improving the diagnosis of diabetic retinopathy (DR) using machine learning and deep learning technologies. Researchers have explored various approaches, including the use of high-definition medical imaging,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Saideep Kilaru , Kothamasu Jayachandra , Tanishka Yagneshwar , Suchi Kumari

Phenotype-driven gene prioritization is a critical process in the diagnosis of rare genetic disorders for identifying and ranking potential disease-causing genes based on observed physical traits or phenotypes. While traditional approaches…

Quantitative Methods · Quantitative Biology 2024-04-04 Junyoung Kim , Jingye Yang , Kai Wang , Chunhua Weng , Cong Liu

The rising prevalence of type 2 diabetes mellitus (T2DM) necessitates the development of predictive models for T2DM risk assessment. Artificial intelligence (AI) models are being extensively used for this purpose, but a comprehensive review…

Machine Learning · Computer Science 2023-05-29 Farida Mohsen , Hamada R. H. Al-Absi , Noha A. Yousri , Nady El Hajj , Zubair Shah

Large language models, such as GPT-4 and Med-PaLM, have shown impressive performance on clinical tasks; however, they require access to compute, are closed-source, and cannot be deployed on device. Mid-size models such as BioGPT-large,…

Large language models (LLMs), such as ChatGPT/GPT-4, have proven to be powerful tools in promoting the user experience as an AI assistant. The continuous works are proposing multi-modal large language models (MLLM), empowering LLMs with the…

Computation and Language · Computer Science 2023-10-23 Ziqiang Zheng , Jipeng Zhang , Tuan-Anh Vu , Shizhe Diao , Yue Him Wong Tim , Sai-Kit Yeung

The efficacy of large language models (LLMs) in domain-specific medicine, particularly for managing complex diseases such as osteoarthritis (OA), remains largely unexplored. This study focused on evaluating and enhancing the clinical…

Computation and Language · Computer Science 2024-01-25 Xi Chen , MingKe You , Li Wang , WeiZhi Liu , Yu Fu , Jie Xu , Shaoting Zhang , Gang Chen , Kang Li , Jian Li

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Diabetes is a chronic disease with a significant global health burden, requiring multi-stakeholder collaboration for optimal management. Large language models (LLMs) have shown promise in various healthcare scenarios, but their…

Computation and Language · Computer Science 2025-03-14 Lai Wei , Zhen Ying , Muyang He , Yutong Chen , Qian Yang , Yanzhe Hong , Jiaping Lu , Kaipeng Zheng , Shaoting Zhang , Xiaoying Li , Weiran Huang , Ying Chen

Effective dementia caregiving requires training and adaptive communication, but assistive AI and robotics are constrained by a lack of context-rich, privacy-sensitive data on how people living with Alzheimer's disease and related dementias…

Human-Computer Interaction · Computer Science 2026-04-01 Kruthika Gangaraju , Shu-Fen Wung , Kevin Berner , Jing Wang , Fengpei Yuan

Domain specific large language models are increasingly used to support patient education, triage, and clinical decision making in ophthalmology, making rigorous evaluation essential to ensure safety and accuracy. This study evaluated four…

Full-process clinical diagnosis in the real world encompasses the entire diagnostic workflow that begins with only an ambiguous chief complaint. While artificial intelligence (AI), particularly large language models (LLMs), is transforming…

Artificial Intelligence · Computer Science 2025-08-15 Shicheng Xu , Xin Huang , Zihao Wei , Liang Pang , Huawei Shen , Xueqi Cheng

Diabetic Retinopathy (DR) is a leading cause of preventable blindness among working-age adults worldwide, yet most automated screening systems are limited to image-level classification and lack clinically structured reporting. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Abdelrahman Zaian , Sheethal Bhat , Mohamed Abdalkader , Andreas Maier

Diabetic Retinopathy (DR) is a common complication of diabetes and a leading cause of blindness worldwide. Early and accurate grading of its severity is crucial for disease management. Although deep learning has shown great potential for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Haoxuan Che , Yuhan Cheng , Haibo Jin , Hao Chen

Large multimodal language models (MLLMs) such as GPT-4V and GPT-4o have achieved remarkable advancements in understanding and generating multimodal content, showcasing superior quality and capabilities across diverse tasks. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Xuelu Feng , Yunsheng Li , Dongdong Chen , Mei Gao , Mengchen Liu , Junsong Yuan , Chunming Qiao

There is increasing interest in the application large language models (LLMs) to the medical field, in part because of their impressive performance on medical exam questions. While promising, exam questions do not reflect the complexity of…