English
Related papers

Related papers: EHRNoteQA: An LLM Benchmark for Real-World Clinica…

200 papers

Large pre-trained language models (LMs) have been widely adopted in biomedical and clinical domains, introducing many powerful LMs such as bio-lm and BioELECTRA. However, the applicability of these methods to real clinical use cases is…

Computation and Language · Computer Science 2022-11-16 Samuel Cahyawijaya , Bryan Wilie , Holy Lovenia , Huan Zhong , MingQian Zhong , Yuk-Yu Nancy Ip , Pascale Fung

Ensuring the accuracy of responses provided by large language models (LLMs) is crucial, particularly in clinical settings where incorrect information may directly impact patient health. To address this challenge, we construct K-QA, a…

Computation and Language · Computer Science 2024-01-29 Itay Manes , Naama Ronn , David Cohen , Ran Ilan Ber , Zehavi Horowitz-Kugler , Gabriel Stanovsky

Large language models (LLMs) have demonstrated powerful text generation capabilities, bringing unprecedented innovation to the healthcare field. While LLMs hold immense promise for applications in healthcare, applying them to real clinical…

Computation and Language · Computer Science 2023-10-16 Rui Yang , Edison Marrese-Taylor , Yuhe Ke , Lechao Cheng , Qingyu Chen , Irene Li

Recently, Large Language Models (LLMs) have gained significant traction in medical domain, especially in developing a QA systems to Medical QA systems for enhancing access to healthcare in low-resourced settings. This paper compares five…

Computation and Language · Computer Science 2026-02-17 Shefayat E Shams Adib , Ahmed Alfey Sani , Ekramul Alam Esham , Ajwad Abrar , Tareque Mohmud Chowdhury

Physician burnout in the United States has reached critical levels, driven in part by the administrative burden of Electronic Health Record (EHR) documentation and complex diagnostic codes. To relieve this strain and maintain strict patient…

Information Retrieval · Computer Science 2026-03-25 Peter Hartnett , Chung-Chi Huang , Sarah Hartnett , David Hartnett

Objective: Electronic health records (EHR) are widely available to complement administrative data-based disease surveillance and healthcare performance evaluation. Defining conditions from EHR is labour-intensive and requires extensive…

Computation and Language · Computer Science 2025-04-09 Jie Pan , Seungwon Lee , Cheligeer Cheligeer , Elliot A. Martin , Kiarash Riazi , Hude Quan , Na Li

While Large Language Models (LLMs) excel on standardized medical exams, high scores often fail to translate to high-quality responses for real-world medical queries. Current evaluations rely heavily on multiple-choice questions, failing to…

Brief hospital course (BHC) summaries are clinical documents that summarize a patient's hospital stay. While large language models (LLMs) depict remarkable capabilities in automating real-world tasks, their capabilities for healthcare…

Recent advances in Large Language Models (LLMs) have led to remarkable progresses in medical consultation. However, existing medical LLMs overlook the essential role of Electronic Health Records (EHR) and focus primarily on diagnosis…

Artificial Intelligence · Computer Science 2025-06-26 Weijieying Ren , Tianxiang Zhao , Lei Wang , Tianchun Wang , Vasant Honavar

Objectives: To evaluate the current limitations of large language models (LLMs) in medical question answering, focusing on the quality of datasets used for their evaluation. Materials and Methods: Widely-used benchmark datasets, including…

Computation and Language · Computer Science 2025-07-15 Mahmoud Alwakeel , Aditya Nagori , Vijay Krishnamoorthy , Rishikesan Kamaleswaran

The increasing volume and complexity of clinical documentation in Electronic Medical Records systems pose significant challenges for clinical coders, who must mentally process and summarise vast amounts of clinical text to extract essential…

Computation and Language · Computer Science 2024-09-25 Bokang Bi , Leibo Liu , Sanja Lujic , Louisa Jorm , Oscar Perez-Concha

Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language…

Information Retrieval · Computer Science 2024-07-03 Ran Elgedawy , Ioana Danciu , Maria Mahbub , Sudarshan Srinivasan

The inherent complexity of structured longitudinal Electronic Health Records (EHR) data poses a significant challenge when integrated with Large Language Models (LLMs), which are traditionally tailored for natural language processing.…

Computation and Language · Computer Science 2024-02-13 Yinghao Zhu , Zixiang Wang , Junyi Gao , Yuning Tong , Jingkun An , Weibin Liao , Ewen M. Harrison , Liantao Ma , Chengwei Pan

Though patients are increasingly granted digital access to their electronic health records (EHRs), existing interfaces may not support precise, trustworthy answers to patient-specific questions. Large language models (LLM) show promise in…

Computation and Language · Computer Science 2026-03-26 Michael Frew , Nishit Bheda , Bryan Tripp

Unstructured text in medical notes and dialogues contains rich information. Recent advancements in Large Language Models (LLMs) have demonstrated superior performance in question answering and summarization tasks on unstructured text data,…

Computation and Language · Computer Science 2024-05-31 Yuhao Chen , Zhimu Wang , Bo Wen , Farhana Zulkernine

Current Large Language Models (LLMs) benchmarks are often based on open-ended or close-ended QA evaluations, avoiding the requirement of human labor. Close-ended measurements evaluate the factuality of responses but lack expressiveness.…

Medical documentation, including discharge notes, is crucial for ensuring patient care quality, continuity, and effective medical communication. However, the manual creation of these documents is not only time-consuming but also prone to…

Computation and Language · Computer Science 2024-04-09 HyoJe Jung , Yunha Kim , Heejung Choi , Hyeram Seo , Minkyoung Kim , JiYe Han , Gaeun Kee , Seohyun Park , Soyoung Ko , Byeolhee Kim , Suyeon Kim , Tae Joon Jun , Young-Hak Kim

Electronic Health Record (EHR) tables pose unique challenges among which is the presence of hidden contextual dependencies between medical features with a high level of data dimensionality and sparsity. This study presents the first…

Computation and Language · Computer Science 2025-01-17 Jesus Lovon , Martin Mouysset , Jo Oleiwan , Jose G. Moreno , Christine Damase-Michel , Lynda Tamine

Medical question-answering (QA) is a critical task for evaluating how effectively large language models (LLMs) encode clinical knowledge and assessing their potential applications in medicine. Despite showing promise on multiple-choice…

Computation and Language · Computer Science 2025-03-06 Guangfu Guo , Kai Zhang , Bryan Hoo , Yujun Cai , Xiaoqian Lu , Nanyun Peng , Yiwei Wang

Accurate prediction of functional outcomes after acute ischemic stroke can inform clinical decision-making and resource allocation. Prior work on modified Rankin Scale (mRS) prediction has relied primarily on structured variables (e.g.,…

‹ Prev 1 3 4 5 6 7 10 Next ›