English
Related papers

Related papers: Leveraging Foundation Models for Clinical Text Ana…

200 papers

Driven by the visions of Data Science, recent years have seen a paradigm shift in Natural Language Processing (NLP). NLP has set the milestone in text processing and proved to be the preferred choice for researchers in the healthcare…

Computers and Society · Computer Science 2020-07-20 Ganga Prasad Basyal , Bhaskar P. Rimal , David Zeng

In this paper, we present our approach to extracting structured information from unstructured Electronic Health Records (EHR) [2] which can be used to, for example, study adverse drug reactions in patients due to chemicals in their…

Computation and Language · Computer Science 2020-01-30 Amogh Kamat Tarcar , Aashis Tiwari , Vineet Naique Dhaimodker , Penjo Rebelo , Rahul Desai , Dattaraj Rao

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Objective: Clinical knowledge enriched transformer models (e.g., ClinicalBERT) have state-of-the-art results on clinical NLP (natural language processing) tasks. One of the core limitations of these transformer models is the substantial…

Computation and Language · Computer Science 2023-01-30 Yikuan Li , Ramsey M. Wehbe , Faraz S. Ahmad , Hanyin Wang , Yuan Luo

Obtaining text datasets with semantic annotations is an effortful process, yet crucial for supervised training in natural language processsing (NLP). In general, developing and applying new NLP pipelines in domain-specific contexts for…

Computation and Language · Computer Science 2022-09-01 Johann Frei , Frank Kramer

Natural language processing (NLP) researchers develop models of grammar, meaning and communication based on written text. Due to task and data differences, what is considered text can vary substantially across studies. A conceptual…

Computation and Language · Computer Science 2023-05-18 Ilia Kuznetsov , Iryna Gurevych

Large Language Models (LLMs) demonstrate remarkable capabilities in replicating human tasks and boosting productivity. However, their direct application for data extraction presents limitations due to a prioritisation of fluency over…

Computation and Language · Computer Science 2024-06-13 Aman Ahluwalia , Suhrud Wani

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

Computation and Language · Computer Science 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

Biomedical Information Extraction is an exciting field at the crossroads of Natural Language Processing, Biology and Medicine. It encompasses a variety of different tasks that require application of state-of-the-art NLP techniques, such as…

Computation and Language · Computer Science 2017-05-17 Surag Nair

Medical reports contain rich clinical information but are often unstructured and written in domain-specific language, posing challenges for information extraction. While proprietary large language models (LLMs) have shown promise in…

Computation and Language · Computer Science 2026-03-12 Luc Builtjes , Joeran Bosma , Mathias Prokop , Bram van Ginneken , Alessa Hering

Natural language processing (NLP) is an area of artificial intelligence that applies information technologies to process the human language, understand it to a certain degree, and use it in various applications. This area has rapidly…

Natural language processing (NLP) has been traditionally applied to medicine, and generative large language models (LLMs) have become prominent recently. However, the differences between them across different medical tasks remain…

Generative models have been showing potential for producing data in mass. This study explores the enhancement of clinical natural language processing performance by utilizing synthetic data generated from advanced language models. Promising…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Jack Gallifant , Marco Guevara , Yanjun Gao , Majid Afshar , Timothy Miller , Dmitriy Dligach , Danielle S. Bitterman

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

The Clinical E-Science Framework (CLEF) project was used to extract important information from medical texts by building a system for the purpose of clinical research, evidence-based healthcare and genotype-meets-phenotype informatics. The…

Information Retrieval · Computer Science 2013-06-24 Wafaa Tawfik Abdel-moneim , Mohamed Hashem Abdel-Aziz , Mohamed Monier Hassan

Identifying critical research within the growing body of academic work is an intrinsic aspect of conducting quality research. Systematic review processes used in evidence-based medicine formalise this as a procedure that must be followed in…

Digital Libraries · Computer Science 2024-10-14 John Hawkins , David Tivey

Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical…

Quantitative Methods · Quantitative Biology 2021-10-20 Xiong Liu , Greg L. Hersch , Iya Khalil , Murthy Devarakonda

Recent advances in natural language processing (NLP) can be largely attributed to the advent of pre-trained language models such as BERT and RoBERTa. While these models demonstrate remarkable performance on general datasets, they can…

While deep learning techniques have shown promising results in many natural language processing (NLP) tasks, it has not been widely applied to the clinical domain. The lack of large datasets and the pervasive use of domain-specific language…

Computation and Language · Computer Science 2019-06-20 Jiin Nam , Seunghyun Yoon , Kyomin Jung

In recent years, transformer-based language models have achieved state of the art performance in various NLP benchmarks. These models are able to extract mostly distributional information with some semantics from unstructured text, however…

Computation and Language · Computer Science 2021-02-08 Pedro Colon-Hernandez , Catherine Havasi , Jason Alonso , Matthew Huggins , Cynthia Breazeal