English
Related papers

Related papers: EHRNoteQA: An LLM Benchmark for Real-World Clinica…

200 papers

World models offer a principled framework for simulating future states under interventions, but realizing such models in complex, high-stakes domains like medicine remains challenging. Recent large language models (LLMs) have achieved…

Artificial Intelligence · Computer Science 2026-02-04 Linjie Mu , Zhongzhen Huang , Yannian Gu , Shengqian Qin , Shaoting Zhang , Xiaofan Zhang

Large language models (LLMs) have recently showcased remarkable capabilities, spanning a wide range of tasks and applications, including those in the medical domain. Models like GPT-4 excel in medical question answering but may face…

Computation and Language · Computer Science 2025-07-02 Bowen Wang , Jiuyang Chang , Yiming Qian , Guoxin Chen , Junhao Chen , Zhouqiang Jiang , Jiahao Zhang , Yuta Nakashima , Hajime Nagahara

Electronic Health Records (EHRs) offer considerable potential for clinical prediction, but their complexity and heterogeneity challenge traditional machine learning. Domain-specific EHR foundation models trained on unlabeled EHR data have…

Healthcare systems continuously generate vast amounts of electronic health records (EHRs), commonly stored in the Fast Healthcare Interoperability Resources (FHIR) standard. Despite the wealth of information in these records, their…

Computation and Language · Computer Science 2025-01-24 Sara Kothari , Ayush Gupta

Large language models (LLMs) are emerging as valuable tools to support clinicians in routine decision-making. HIV management is a compelling use case due to its complexity, including diverse treatment options, comorbidities, and adherence…

Computation and Language · Computer Science 2025-07-28 Gonzalo Cardenal-Antolin , Jacques Fellay , Bashkim Jaha , Roger Kouyos , Niko Beerenwinkel , Diane Duroux

We propose a novel methodology to generate domain-specific large-scale question answering (QA) datasets by re-purposing existing annotations for other NLP tasks. We demonstrate an instance of this methodology in generating a large-scale QA…

Computation and Language · Computer Science 2018-09-05 Anusri Pampari , Preethi Raghavan , Jennifer Liang , Jian Peng

The development of Electronic Health Records summarization systems has revolutionized patient data management. Previous research advanced this field by adapting Large Language Models for clinical tasks, using diverse datasets to generate…

Computation and Language · Computer Science 2024-10-15 Ruvarashe Madzime , Clement Nyirenda

Data consistency between unstructured clinical notes and structured tables in Electronic Health Records (EHRs) is essential for patient safety and clinical decision-making. However, existing work on note-table consistency verification…

Electronic Health Records (EHRs) are pivotal in clinical practices, yet their retrieval remains a challenge mainly due to semantic gap issues. Recent advancements in dense retrieval offer promising solutions but existing models, both…

Information Retrieval · Computer Science 2025-07-25 Zhengyun Zhao , Huaiyuan Ying , Yue Zhong , Sheng Yu

Europe's healthcare systems require enhanced interoperability and digitalization, driving a demand for innovative solutions to process legacy clinical data. This paper presents the results of our project, which aims to leverage Large…

Computation and Language · Computer Science 2025-07-09 Aynur Guluzade , Naguib Heiba , Zeyd Boukhers , Florim Hamiti , Jahid Hasan Polash , Yehya Mohamad , Carlos A Velasco

Recent advancements in Large Language Models (LLMs) have pushed the boundaries of natural language processing, especially in long-context understanding. However, the evaluation of these models' long-context abilities remains a challenge due…

Computation and Language · Computer Science 2025-04-24 Cunxiang Wang , Ruoxi Ning , Boqi Pan , Tonghui Wu , Qipeng Guo , Cheng Deng , Guangsheng Bao , Xiangkun Hu , Zheng Zhang , Qian Wang , Yue Zhang

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti

While Medical Large Language Models (MedLLMs) have demonstrated remarkable potential in clinical tasks, their ethical safety remains insufficiently explored. This paper introduces $\textbf{MedEthicsQA}$, a comprehensive benchmark comprising…

Computation and Language · Computer Science 2025-07-01 Jianhui Wei , Zijie Meng , Zikai Xiao , Tianxiang Hu , Yang Feng , Zhijie Zhou , Jian Wu , Zuozhu Liu

Despite the remarkable performance of Large Language Models (LLMs) in automated discharge summary generation, they still suffer from hallucination issues, such as generating inaccurate content or fabricating information without valid…

Computation and Language · Computer Science 2025-07-09 Cheng Yuan , Xinkai Rui , Yongqi Fan , Yawei Fan , Boyang Zhong , Jiacheng Wang , Weiyan Zhang , Tong Ruan

Question Answering (QA) systems on patient-related data can assist both clinicians and patients. They can, for example, assist clinicians in decision-making and enable patients to have a better understanding of their medical history.…

Machine Learning · Computer Science 2023-11-09 Jayetri Bardhan , Kirk Roberts , Daisy Zhe Wang

Large language models (LLMs) have shown promise in safety-critical applications such as healthcare, yet the ability to quantify performance has lagged. An example of this challenge is in evaluating a summary of the patient's medical record.…

Computation and Language · Computer Science 2024-11-13 Elliot Schumacher , Daniel Rosenthal , Dhruv Naik , Varun Nair , Luladay Price , Geoffrey Tso , Anitha Kannan

Clinical language models are important for many applications in healthcare, but their development depends on access to extensive clinical text for pretraining. However, obtaining clinical notes from electronic health records (EHRs) at scale…

Computation and Language · Computer Science 2024-12-02 Jinghui Liu , Anthony Nguyen

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

Large language models (LLMs) have excelled across domains, also delivering notable performance on the medical evaluation benchmarks, such as MedQA. However, there still exists a significant gap between the reported performance and the…

Computation and Language · Computer Science 2024-06-06 Yuxuan Zhou , Xien Liu , Chen Ning , Ji Wu