English
Related papers

Related papers: Evaluating Large Language Models on Rare Disease D…

200 papers

The recent swift development of LLMs like GPT-4, Gemini, and GPT-3.5 offers a transformative opportunity in medicine and healthcare, especially in digital diagnostics. This study evaluates each model diagnostic abilities by interpreting a…

Computation and Language · Computer Science 2024-05-14 Gaurav Kumar Gupta , Aditi Singh , Sijo Valayakkad Manikandan , Abul Ehtesham

Clinical document classification is essential for converting unstructured medical texts into standardised ICD-10 diagnoses, yet it faces challenges due to complex medical language, privacy constraints, and limited annotated datasets. Large…

Computation and Language · Computer Science 2026-02-03 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Advancements in deep learning have generated a large-scale interest in the development of foundational deep learning models. The development of Large Language Models (LLM) has evolved as a transformative paradigm in conversational tasks,…

Computation and Language · Computer Science 2024-08-01 Nikil Sharan Prabahar Balasubramanian , Sagnik Dakshit

Generalist Large Language Models (LLMs), such as GPT-4, have shown considerable promise in various domains, including medical diagnosis. Rare diseases, affecting approximately 300 million people worldwide, often have unsatisfactory clinical…

Computation and Language · Computer Science 2024-07-08 Xuanzhong Chen , Xiaohao Mao , Qihan Guo , Lun Wang , Shuyang Zhang , Ting Chen

Large language models (LLMs) have demonstrated impressive capabilities in disease diagnosis. However, their effectiveness in identifying rarer diseases, which are inherently more challenging to diagnose, remains an open question. Rare…

Computation and Language · Computer Science 2025-02-24 Elliot Schumacher , Dhruv Naik , Anitha Kannan

Recent advances in artificial intelligence, particularly large language models LLMs, have shown promising capabilities in transforming rare disease research. This survey paper explores the integration of LLMs in the analysis of rare…

Computation and Language · Computer Science 2025-05-26 Valentina Carbonari , Pierangelo Veltri , Pietro Hiram Guzzi

Large language models have the potential to be valuable in the healthcare industry, but it's crucial to verify their safety and effectiveness through rigorous evaluation. For this purpose, we comprehensively evaluated both open-source LLMs…

Computation and Language · Computer Science 2024-02-13 Ankit Pal , Malaikannan Sankarasubbu

Large language models (LLMs) have demonstrated impressive performance across various domains. However, for clinical diagnosis, higher expectations are required for LLM's reliability and sensitivity: thinking like physicians and remaining…

Computation and Language · Computer Science 2025-04-21 Chenwei Yan , Xiangling Fu , Yuxuan Xiong , Tianyi Wang , Siu Cheung Hui , Ji Wu , Xien Liu

Rare diseases affect over 300 million people worldwide and are characterized by complex care pathways, limited clinical expertise, and substantial unmet communication needs throughout the long patient journey. Recent advances in large…

Computation and Language · Computer Science 2026-04-17 Zaifu Zhan , Yu Hou , Kai Yu , Min Zeng , Anita Burgun , Xiaoyi Chen , Rui Zhang

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

Computation and Language · Computer Science 2025-09-16 Can Wang , Yiqun Chen

Large Language Models (LLMs) are revolutionizing medical diagnostics by enhancing both disease classification and clinical decision-making. In this study, we evaluate the performance of two LLM- based diagnostic tools, DeepSeek R1 and O3…

Computation and Language · Computer Science 2025-06-23 Gaurav Kumar Gupta , Pranal Pande , Nirajan Acharya , Aniket Kumar Singh , Suman Niroula

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where…

Large language models (LLMs) show promise for supporting clinical decision-making in complex fields such as rheumatology. Our evaluation shows that smaller language models (SLMs), combined with retrieval-augmented generation (RAG), achieve…

Computation and Language · Computer Science 2025-07-11 Sabine Felde , Rüdiger Buchkremer , Gamal Chehab , Christian Thielscher , Jörg HW Distler , Matthias Schneider , Jutta G. Richter

Phenotype-driven gene prioritization is a critical process in the diagnosis of rare genetic disorders for identifying and ranking potential disease-causing genes based on observed physical traits or phenotypes. While traditional approaches…

Quantitative Methods · Quantitative Biology 2024-04-04 Junyoung Kim , Jingye Yang , Kai Wang , Chunhua Weng , Cong Liu

The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear…

Computation and Language · Computer Science 2024-05-21 Zhoujian Sun , Cheng Luo , Ziyi Liu , Zhengxing Huang

Radiology reports summarize key findings and differential diagnoses derived from medical imaging examinations. The extraction of differential diagnoses is crucial for downstream tasks, including patient management and treatment planning.…

Computation and Language · Computer Science 2024-10-15 Luoyao Chen , Revant Teotia , Antonio Verdone , Aidan Cardall , Lakshay Tyagi , Yiqiu Shen , Sumit Chopra

Universal healthcare access is critically needed, especially in resource-limited settings. Large Language Models (LLMs) offer promise for democratizing healthcare with advanced diagnostics, but their reliability requires thorough…

Computation and Language · Computer Science 2025-03-17 Krishna Subedi

Large language models (LLMs) have garnered significant attention and widespread usage due to their impressive performance in various tasks. However, they are not without their own set of challenges, including issues such as hallucinations,…

Computation and Language · Computer Science 2024-05-08 Duygu Altinok

Rare diseases affect hundreds of millions worldwide, yet diagnosis often spans years. Convectional pipelines decouple noisy evidence extraction from downstream inferential diagnosis, and general/medical large language models (LLMs) face…

Large Language Models (LLMs) like GPT-4, MedPaLM-2, and Med-Gemini achieve performance competitively with human experts across various medical benchmarks. However, they still face challenges in making professional diagnoses akin to…

Computation and Language · Computer Science 2024-08-23 Xiaohan Wang , Xiaoyan Yang , Yuqi Zhu , Yue Shen , Jian Wang , Peng Wei , Lei Liang , Jinjie Gu , Huajun Chen , Ningyu Zhang
‹ Prev 1 2 3 10 Next ›