English
Related papers

Related papers: EHRNoteQA: An LLM Benchmark for Real-World Clinica…

200 papers

This paper develops the first question answering dataset (DrugEHRQA) containing question-answer pairs from both structured tables and unstructured notes from a publicly available Electronic Health Record (EHR). EHRs contain patient records,…

Artificial Intelligence · Computer Science 2022-05-04 Jayetri Bardhan , Anthony Colas , Kirk Roberts , Daisy Zhe Wang

Biomedical question answering (QA) poses significant challenges due to the need for precise interpretation of specialized knowledge drawn from a vast, complex, and rapidly evolving corpus. In this work, we explore how large language models…

Computation and Language · Computer Science 2025-09-11 Dima Galat , Diego Molla-Aliod

Electronic health records (EHRs) store an extensive array of patient information, encompassing medical histories, diagnoses, treatments, and test outcomes. These records are crucial for enabling healthcare providers to make well-informed…

Computation and Language · Computer Science 2023-08-07 Yu-Neng Chuang , Ruixiang Tang , Xiaoqian Jiang , Xia Hu

Effective patient care in digital healthcare requires large language models (LLMs) that not only answer questions but also actively gather critical information through well-crafted inquiries. This paper introduces HealthQ, a novel framework…

Computation and Language · Computer Science 2025-02-26 Ziyu Wang , Hao Li , Di Huang , Hye-Sung Kim , Chae-Won Shin , Amir M. Rahmani

Objective: Large language models (LLMs) are increasingly applied in biomedical settings, and existing benchmark datasets have played an important role in supporting model development and evaluation. However, these benchmarks often have…

Computation and Language · Computer Science 2026-01-21 Kriti Bhattarai , Vipina K. Keloth , Donald Wright , Andrew Loza , Yang Ren , Hua Xu

Summarizing consumer health questions (CHQs) can ease communication in healthcare, but unfaithful summaries that misrepresent medical details pose serious risks. We propose a framework that combines TextRank-based sentence extraction and…

Computation and Language · Computer Science 2025-11-17 Ajwad Abrar , Nafisa Tabassum Oeshy , Prianka Maheru , Farzana Tabassum , Tareque Mohmud Chowdhury

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

The global shortage of healthcare workers has demanded the development of smart healthcare assistants, which can help monitor and alert healthcare workers when necessary. We examine the healthcare knowledge of existing Large Vision Language…

Computation and Language · Computer Science 2024-10-10 Sourjyadip Ray , Kushal Gupta , Soumi Kundu , Payal Arvind Kasat , Somak Aditya , Pawan Goyal

Discharge Summaries are documents written by medical professionals that detail a patient's visit to a care facility. They contain a wealth of information crucial for patient care, and automating their generation could significantly reduce…

Computation and Language · Computer Science 2025-12-09 Tiago Rodrigues , Carla Teixeira Lopes

We present a new text-to-SQL dataset for electronic health records (EHRs). The utterances were collected from 222 hospital staff members, including physicians, nurses, and insurance review and health records teams. To construct the QA…

Computation and Language · Computer Science 2026-03-06 Gyubok Lee , Hyeonji Hwang , Seongsu Bae , Yeonsu Kwon , Woncheol Shin , Seongjun Yang , Minjoon Seo , Jong-Yeup Kim , Edward Choi

Large Language Models (LLMs) have shown strong promise for mining Electronic Health Records (EHRs) by reasoning over longitudinal clinical information to capture context-rich patient trajectories. However, leveraging LLMs for structured…

Computation and Language · Computer Science 2026-04-21 Arya Hadizadeh Moghaddam , Drew Ross , Mohsen Nayebi Kerdabadi , Dongjie Wang , Zijun Yao

Analyzing vast textual data and summarizing key information from electronic health records imposes a substantial burden on how clinicians allocate their time. Although large language models (LLMs) have shown promise in natural language…

LLMs have demonstrated impressive performance in answering medical questions, such as achieving passing scores on medical licensing examinations. However, medical board exams or general clinical questions do not capture the complexity of…

Computation and Language · Computer Science 2026-02-19 Hanjie Chen , Zhouxiang Fang , Yash Singla , Mark Dredze

Electronic health records (EHRs) are long, noisy, and often redundant, posing a major challenge for the clinicians who must navigate them. Large language models (LLMs) offer a promising solution for extracting and reasoning over this…

Computation and Language · Computer Science 2025-08-21 Skatje Myers , Dmitriy Dligach , Timothy A. Miller , Samantha Barr , Yanjun Gao , Matthew Churpek , Anoop Mayampurath , Majid Afshar

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

The work in this paper evaluates zero-shot and few-shot large language models (LLMs) for safety-critical clinical action extraction using the CLIP discharge-note dataset, with particular emphasis on transitions of care and post-discharge…

Artificial Intelligence · Computer Science 2026-05-08 Shivali Dalmia , Ananya Mantravadi , Prasanna Desikan

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

The evaluation of Large Language Models (LLMs) in healthcare has been dominated by physician-centric, English-language benchmarks, creating a dangerous illusion of competence that ignores the interprofessional nature of patient care. To…

Computation and Language · Computer Science 2025-06-30 Andrew Maranhão Ventura D'addario

Clinical documentation is an important aspect of clinicians' daily work and often demands a significant amount of time. The BioNLP 2024 Shared Task on Streamlining Discharge Documentation (Discharge Me!) aims to alleviate this documentation…

Computation and Language · Computer Science 2024-07-04 Jinghui Liu , Aaron Nicolson , Jason Dowling , Bevan Koopman , Anthony Nguyen

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…