English
Related papers

Related papers: SimSUM: Simulated Benchmark with Structured and Un…

200 papers

After decades of use in dictation and, more recently, ambient documentation, speech is emerging as a primary modality for interacting with technology and AI in healthcare. Yet medical speech recognition remains difficult: systems must…

Machine Learning · Computer Science 2026-05-22 Arne Nix , Robert James , Lasse Borgholt , Anna B. Ekner , Lana Krumm , Julius Severin , Dan Engel , Lars Maaløe , Jakob Havtorn

Clinical decision-making requires synthesizing heterogeneous evidence, including patient histories, clinical guidelines, and trajectories of comparable cases. While large language models (LLMs) offer strong reasoning capabilities, they…

Artificial Intelligence · Computer Science 2026-03-03 Shuheng Chen , Namratha Patil , Haonan Pan , Angel Hsing-Chi Hwang , Yao Du , Ruishan Liu , Jieyu Zhao

Large Language Models have advanced clinical text classification, but their opaque predictions remain a critical barrier to practical adoption in research and clinical settings where investigators and physicians need to understand which…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson

The lack of standardized evaluation benchmarks in the medical domain for text inputs can be a barrier to widely adopting and leveraging the potential of natural language models for health-related downstream tasks. This paper revisited an…

Computation and Language · Computer Science 2025-04-30 Jesus Lovon , Thouria Ben-Haddi , Jules Di Scala , Jose G. Moreno , Lynda Tamine

Labelling data is expensive and time consuming especially for domains such as medical imaging that contain volumetric imaging data and require expert knowledge. Exploiting a larger pool of labeled data available across multiple centers,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Daiqing Li , Amlan Kar , Nishant Ravikumar , Alejandro F Frangi , Sanja Fidler

Background: Recent advancements in large language models (LLMs) offer potential benefits in healthcare, particularly in processing extensive patient records. However, existing benchmarks do not fully assess LLMs' capability in handling…

This paper introduces CaseSumm, a novel dataset for long-context summarization in the legal domain that addresses the need for longer and more complex datasets for summarization evaluation. We collect 25.6K U.S. Supreme Court (SCOTUS)…

Computation and Language · Computer Science 2025-01-03 Mourad Heddaya , Kyle MacMillan , Anup Malani , Hongyuan Mei , Chenhao Tan

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

Machine Learning · Computer Science 2023-06-09 Aleksa Bisercic , Mladen Nikolic , Mihaela van der Schaar , Boris Delibasic , Pietro Lio , Andrija Petrovic

There is a growing interest in creating tools to assist in clinical note generation using the audio of provider-patient encounters. Motivated by this goal and with the help of providers and medical scribes, we developed an annotation scheme…

This study introduces a transformative framework for medical education by integrating semi-structured data with Large Language Models (LLMs), primarily OpenAIs ChatGPT3.5, to automate the creation of medical simulation scenarios.…

Computation and Language · Computer Science 2024-05-07 Scott Sumpter

Discharge summaries in Electronic Health Records (EHRs) are crucial for clinical decision-making, but their length and complexity make information extraction challenging, especially when dealing with accumulated summaries across multiple…

Computation and Language · Computer Science 2024-11-12 Sunjun Kweon , Jiyoun Kim , Heeyoung Kwak , Dongchul Cha , Hangyul Yoon , Kwanghyun Kim , Jeewon Yang , Seunghyun Won , Edward Choi

Electronic Health Records (EHRs) are integral for storing comprehensive patient medical records, combining structured data (e.g., medications) with detailed clinical notes (e.g., physician notes). These elements are essential for…

Computation and Language · Computer Science 2024-12-31 Yeonsu Kwon , Jiho Kim , Gyubok Lee , Seongsu Bae , Daeun Kyung , Wonchul Cha , Tom Pollard , Alistair Johnson , Edward Choi

Discharge communication is a critical yet underexplored component of patient care, where the goal shifts from diagnosis to education. While recent large language model (LLM) benchmarks emphasize in-visit diagnostic reasoning, they fail to…

Computation and Language · Computer Science 2025-09-22 Zonghai Yao , Michael Sun , Won Seok Jang , Sunjae Kwon , Soie Kwon , Hong Yu

Physician burnout in the United States has reached critical levels, driven in part by the administrative burden of Electronic Health Record (EHR) documentation and complex diagnostic codes. To relieve this strain and maintain strict patient…

Information Retrieval · Computer Science 2026-03-25 Peter Hartnett , Chung-Chi Huang , Sarah Hartnett , David Hartnett

Current medical language model (LM) benchmarks often over-simplify the complexities of day-to-day clinical practice tasks and instead rely on evaluating LMs on multiple-choice board exam questions. In psychiatry especially, these challenges…

The majority of available text summarization datasets include short-form source documents that lack long-range causal and temporal dependencies, and often contain strong layout and stylistic biases. While relevant, such datasets will offer…

Computation and Language · Computer Science 2022-12-08 Wojciech Kryściński , Nazneen Rajani , Divyansh Agarwal , Caiming Xiong , Dragomir Radev

Medical large language models (LLMs) achieve impressive performance on standardized benchmarks, yet these evaluations fail to capture the complexity of real clinical encounters where patients exhibit memory gaps, limited health literacy,…

Artificial Intelligence · Computer Science 2026-04-14 Sina Mansouri , Mohit Marvania , Vibhavari Ashok Shihorkar , Han Ngoc Tran , Kazhal Shafiei , Mehrdad Fazli , Yikuan Li , Ziwei Zhu

Motivation: Patient-generated text contains critical information about patients' lived experiences, social circumstances, and engagement in care, including factors that strongly influence adherence, care coordination, and health equity.…

Computation and Language · Computer Science 2026-03-09 Samah Fodeh , Linhai Ma , Ganesh Puthiaraju , Srivani Talakokkul , Afshan Khan , Ashley Hagaman , Sarah Lowe , Aimee Roundtree

Electronic health records (EHR) contain large volumes of unstructured text, requiring the application of Information Extraction (IE) technologies to enable clinical analysis. We present the open-source Medical Concept Annotation Toolkit…

Clinical documentation can be transformed by Electronic Health Records, yet the documentation process is still a tedious, time-consuming, and error-prone process. Clinicians are faced with multi-faceted requirements and fragmented…

Human-Computer Interaction · Computer Science 2021-09-24 Luke Murray , Divya Gopinath , Monica Agrawal , Steven Horng , David Sontag , David R. Karger