English
Related papers

Related papers: PeruMedQA: Benchmarking Large Language Models (LLM…

200 papers

Large language models (LLMs) show promise for clinical use. They are often evaluated using datasets such as MedQA. However, Many medical datasets, such as MedQA, rely on simplified Question-Answering (Q\A) that underrepresents real-world…

Computation and Language · Computer Science 2025-10-24 Yunpeng Xiao , Carl Yang , Mark Mai , Xiao Hu , Kai Shu

Large Language Models (LLMs) have demonstrated remarkable adaptability, showcasing their capacity to excel in tasks for which they were not explicitly trained. However, despite their impressive natural language processing (NLP)…

Computation and Language · Computer Science 2023-09-08 Supun Manathunga , Isuru Hettigoda

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where…

Research on language technology for the development of medical applications is currently a hot topic in Natural Language Understanding and Generation. Thus, a number of large language models (LLMs) have recently been adapted to the medical…

Large language models (LLMs) have demonstrated impressive performance across various domains. However, for clinical diagnosis, higher expectations are required for LLM's reliability and sensitivity: thinking like physicians and remaining…

Computation and Language · Computer Science 2025-04-21 Chenwei Yan , Xiangling Fu , Yuxuan Xiong , Tianyi Wang , Siu Cheung Hui , Ji Wu , Xien Liu

Models such as GPT-4 and Med-PaLM 2 have demonstrated impressive performance on a wide variety of biomedical NLP tasks. However, these models have hundreds of billions of parameters, are computationally expensive to run, require users to…

While Large Language Models (LLMs) have demonstrated high proficiency on English-centric medical examinations, their performance often declines when faced with non-English languages and multimodal diagnostic tasks. This study protocol…

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of…

Pre-trained LLMs have demonstrated substantial capabilities across a range of conventional natural language processing (NLP) tasks, such as summarization and entity recognition. In this paper, we explore the application of LLMs in the…

Quantitative Methods · Quantitative Biology 2024-08-14 Kamyar Zeinalipour , Neda Jamshidi , Monica Bianchini , Marco Maggini , Marco Gori

Patients with diabetes are at increased risk of comorbid depression or anxiety, complicating their management. This study evaluated the performance of large language models (LLMs) in detecting these symptoms from secure patient messages. We…

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

Artificial Intelligence · Computer Science 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

The current work investigates the capability of Large language models (LLMs) that are explicitly trained on large corpuses of medical knowledge (Med-PaLM 2) to predict psychiatric functioning from patient interviews and clinical…

Computation and Language · Computer Science 2023-08-04 Isaac R. Galatzer-Levy , Daniel McDuff , Vivek Natarajan , Alan Karthikesalingam , Matteo Malgaroli

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of general-domain tasks. However, their effectiveness in specialized fields, such as construction, remains underexplored. In this paper, we introduce…

Computation and Language · Computer Science 2025-08-25 Yanzhao Wu , Lufan Wang , Rui Liu

Large Language Models (LLMs) such as GPT-4 and LLaMA have demonstrated remarkable reasoning abilities but require significant computational resources for fine-tuning. This paper presents a resource-efficient fine-tuning approach for…

Computation and Language · Computer Science 2025-10-07 Imran Mansha

Question answering is a natural language understanding task that involves reasoning over both explicit context, and unstated relevant domain knowledge. Despite the high cost of training, large language models (LLMs) -- the backbone of most…

Computation and Language · Computer Science 2025-04-24 Laura Cabello , Carmen Martin-Turrero , Uchenna Akujuobi , Anders Søgaard , Carlos Bobed

Large Language Models (LLMs) are revolutionizing medical diagnostics by enhancing both disease classification and clinical decision-making. In this study, we evaluate the performance of two LLM- based diagnostic tools, DeepSeek R1 and O3…

Computation and Language · Computer Science 2025-06-23 Gaurav Kumar Gupta , Pranal Pande , Nirajan Acharya , Aniket Kumar Singh , Suman Niroula

Large language models (LLMs) show significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities. However, concerns persist regarding the reliability of these benchmarks, which often lack clinical…

Computation and Language · Computer Science 2026-04-30 Wenting Chen , Guo Yu , Yiu-Fai Cheung , Meidan Ding , Jie Liu , Zizhan Ma , Wenxuan Wang , Linlin Shen

Large Language Models (LLMs) are expected to significantly contribute to patient care, diagnostics, and administrative processes. Emerging biomedical LLMs aim to address healthcare-specific challenges, including privacy demands and…

Computation and Language · Computer Science 2025-10-14 Amin Dada , Marie Bauer , Amanda Butler Contreras , Osman Alperen Koraş , Constantin Marc Seibold , Kaleb E Smith , Jens Kleesiek

Rapid integration of large language models (LLMs) in health care is sparking global discussion about their potential to revolutionize health care quality and accessibility. At a time when improving health care quality and access remains a…

Computers and Society · Computer Science 2025-04-01 Troy Zada , Natalie Tam , Francois Barnard , Marlize Van Sittert , Venkat Bhat , Sirisha Rambhatla

Large Vision-Language Models (LVLMs) have shown significant potential in assisting medical diagnosis by leveraging extensive biomedical datasets. However, the advancement of medical image understanding and reasoning critically depends on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Guohao Sun , Can Qin , Huazhu Fu , Linwei Wang , Zhiqiang Tao