English
Related papers

Related papers: Information Extraction from Clinical Notes: Are We…

200 papers

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Identifying medication discontinuations in electronic health records (EHRs) is vital for patient safety but is often hindered by information being buried in unstructured notes. This study aims to evaluate the capabilities of advanced…

Computation and Language · Computer Science 2025-11-10 Chong Shao , Douglas Snyder , Chiran Li , Bowen Gu , Kerry Ngan , Chun-Ting Yang , Jiageng Wu , Richard Wyss , Kueiyu Joshua Lin , Jie Yang

This work presents our participation in the EvalLLM 2025 challenge on biomedical Named Entity Recognition (NER) and health event extraction in French (few-shot setting). For NER, we propose three approaches combining large language models…

The surging amount of biomedical literature & digital clinical records presents a growing need for text mining techniques that can not only identify but also semantically relate entities in unstructured data. In this paper we propose a text…

Computation and Language · Computer Science 2021-12-28 Hasham Ul Haq , Veysel Kocaman , David Talby

Information extraction (IE) aims to extract structural knowledge from plain natural language texts. Recently, generative Large Language Models (LLMs) have demonstrated remarkable capabilities in text understanding and generation. As a…

Computation and Language · Computer Science 2024-11-01 Derong Xu , Wei Chen , Wenjun Peng , Chao Zhang , Tong Xu , Xiangyu Zhao , Xian Wu , Yefeng Zheng , Yang Wang , Enhong Chen

This study is dedicated to assessing the capabilities of large language models (LLMs) such as GPT-3.5-Turbo, GPT-4, and GPT-4-Turbo in extracting structured information from scientific documents in materials science. To this end, we…

Computation and Language · Computer Science 2024-06-03 Luca Foppiano , Guillaume Lambard , Toshiyuki Amagasa , Masashi Ishii

Large language models (LLMs) pre-trained on massive corpora have demonstrated impressive few-shot learning ability on many NLP tasks. A common practice is to recast the task into a text-to-text format such that generative LLMs of natural…

Computation and Language · Computer Science 2023-05-12 Peng Li , Tianxiang Sun , Qiong Tang , Hang Yan , Yuanbin Wu , Xuanjing Huang , Xipeng Qiu

The unstructured nature of clinical notes within electronic health records often conceals vital patient-related information, making it challenging to access or interpret. To uncover this hidden information, specialized Natural Language…

Large Language Models (LLMs) are increasingly deployed in medicine. However, their utility in non-generative clinical prediction, often presumed inferior to specialized models, remains under-evaluated, leading to ongoing debate within the…

Large Language Models (LLMs) have revolutionized various sectors, including healthcare where they are employed in diverse applications. Their utility is particularly significant in the context of rare diseases, where data scarcity,…

Computation and Language · Computer Science 2024-08-20 Qiuhao Lu , Rui Li , Andrew Wen , Jinlian Wang , Liwei Wang , Hongfang Liu

This study applies Large Language Models (LLMs) to two foundational Electronic Health Record (EHR) data science tasks: structured data querying (using programmatic languages, Python/Pandas) and information extraction from unstructured…

Computation and Language · Computer Science 2026-01-29 Juan Jose Rubio Jan , Jack Wu , Julia Ive

Relation extraction (RE) aims to identify relations between entities mentioned in texts. Although large language models (LLMs) have demonstrated impressive in-context learning (ICL) abilities in various tasks, they still suffer from poor…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Wenjun Ke , Yikai Guo , Ke Ji , Ziyu Shang , Jiajun Liu , Zijie Xu

Objective: To evaluate the accuracy, computational cost and portability of a new Natural Language Processing (NLP) method for extracting medication information from clinical narratives. Materials and Methods: We propose an original…

Large Language Models (LLMs) have made remarkable strides in various tasks. Whether LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains an open problem. In this work, we aim to provide a thorough…

Computation and Language · Computer Science 2024-04-15 Yubo Ma , Yixin Cao , YongChing Hong , Aixin Sun

Information Extraction (IE) is crucial for converting unstructured data into structured formats like Knowledge Graphs (KGs). A key task within IE is Relation Extraction (RE), which identifies relationships between entities in text. Various…

Computation and Language · Computer Science 2024-06-25 Sefika Efeoglu , Adrian Paschke

Large language models (LLMs) have made significant progress in various domains, including healthcare. However, the specialized nature of clinical language understanding tasks presents unique challenges and limitations that warrant further…

Computation and Language · Computer Science 2023-08-01 Yuqing Wang , Yun Zhao , Linda Petzold

Proprietary Large Language Models (LLMs) such as GPT-4 and Gemini have demonstrated promising capabilities in clinical text summarization tasks. However, due to patient data privacy concerns and computational costs, many healthcare…

The advancement of Large Language Models (LLMs) has significantly impacted biomedical Natural Language Processing (NLP), enhancing tasks such as named entity recognition, relation extraction, event extraction, and text classification. In…

Computation and Language · Computer Science 2025-03-04 Zaifu Zhan , Shuang Zhou , Huixue Zhou , Jiawen Deng , Yu Hou , Jeremy Yeung , Rui Zhang

Rare diseases, including Inborn Errors of Metabolism (IEM), pose significant diagnostic challenges. Case reports serve as key but computationally underutilized resources to inform diagnosis. Clinical dense information extraction refers to…

Computation and Language · Computer Science 2025-05-26 Xiao Yu Cindy Zhang , Carlos R. Ferreira , Francis Rossignol , Raymond T. Ng , Wyeth Wasserman , Jian Zhu

This paper defines and explores the design space for information extraction (IE) from layout-rich documents using large language models (LLMs). The three core challenges of layout-aware IE with LLMs are 1) data structuring, 2) model…

Computation and Language · Computer Science 2026-02-04 Gaye Colakoglu , Gürkan Solmaz , Jonathan Fürst