English
Related papers

Related papers: Efficiently Reusing Natural Language Processing Mo…

200 papers

The rising rate of drug-related deaths in the United States, largely driven by fentanyl, requires timely and accurate surveillance. However, critical overdose data are often buried in free-text coroner reports, leading to delays and…

Clinical natural language processing (NLP) is increasingly in demand in both clinical research and operational practice. However, most of the state-of-the-art solutions are transformers-based and require high computational resources,…

Computation and Language · Computer Science 2025-04-18 Jianlin Shi , Qiwei Gan , Elizabeth Hanchrow , Annie Bowles , John Stanley , Adam P. Bress , Jordana B. Cohen , Patrick R. Alba

The introduction of Large Language Models (LLMs), and the vast volume of publicly available medical data, amplified the application of NLP to the medical domain. However, LLMs are pretrained on data that are not explicitly relevant to the…

Computation and Language · Computer Science 2023-12-12 Chris Solomou

This thesis provides methods and analysis of models which make progress on this goal. The techniques outlined are task agnostic, and should provide benefit when used with nearly any transformer LM. We introduce two new finetuning methods…

Computation and Language · Computer Science 2024-08-30 Davis Yoshida

Most state-of-the-art models in natural language processing (NLP) are neural models built on top of large, pre-trained, contextual language models that generate representations of words in context and are fine-tuned for the task at hand.…

Computation and Language · Computer Science 2020-10-13 Brian Lester , Daniel Pressel , Amy Hemmeter , Sagnik Ray Choudhury , Srinivas Bangalore

Clinical patient notes are critical for documenting patient interactions, diagnoses, and treatment plans in medical practice. Ensuring accurate evaluation of these notes is essential for medical education and certification. However, manual…

Computation and Language · Computer Science 2024-01-25 Jingyu Xu , Yifeng Jiang , Bin Yuan , Shulin Li , Tianbo Song

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

Computation and Language · Computer Science 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

Despite advances in machine learning (ML) and large language models (LLMs), rule-based natural language processing (NLP) systems remain active in clinical settings due to their interpretability and operational efficiency. However, their…

Computation and Language · Computer Science 2025-06-23 Jianlin Shi , Brian T. Bucher

Natural language processing (NLP) is a key technology to extract important patient information from clinical narratives to support healthcare applications. The rapid development of large language models (LLMs) has revolutionized many NLP…

Computation and Language · Computer Science 2025-09-08 Cheng Peng , Xinyu Dong , Mengxian Lyu , Daniel Paredes , Yaoyun Zhang , Yonghui Wu

Electronic health records (EHRs), digital collections of patient healthcare events and observations, are ubiquitous in medicine and critical to healthcare delivery, operations, and research. Despite this central role, EHRs are notoriously…

Obtaining text datasets with semantic annotations is an effortful process, yet crucial for supervised training in natural language processsing (NLP). In general, developing and applying new NLP pipelines in domain-specific contexts for…

Computation and Language · Computer Science 2022-09-01 Johann Frei , Frank Kramer

Objective: This review aims to analyze the application of natural language processing (NLP) techniques in cancer research using electronic health records (EHRs) and clinical notes. This review addresses gaps in the existing literature by…

Computation and Language · Computer Science 2025-02-05 Muhammad Bilal , Ameer Hamza , Nadia Malik

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

A key component of deep learning (DL) for natural language processing (NLP) is word embeddings. Word embeddings that effectively capture the meaning and context of the word that they represent can significantly improve the performance of…

Objective: To automatically create large labeled training datasets and reduce the efforts of feature engineering for training accurate machine learning models for clinical information extraction. Materials and Methods: We propose a distant…

Information Retrieval · Computer Science 2018-04-24 Yanshan Wang , Sunghwan Sohn , Sijia Liu , Feichen Shen , Liwei Wang , Elizabeth J. Atkinson , Shreyasee Amin , Hongfang Liu

In Biomedical Natural Language Processing (BioNLP) tasks, such as Relation Extraction, Named Entity Recognition, and Text Classification, the scarcity of high-quality data remains a significant challenge. This limitation poisons large…

Computation and Language · Computer Science 2025-04-01 Zhengyi Zhao , Shubo Zhang , Bin Liang , Binyang Li , Kam-Fai Wong

This paper presents a portable phenotyping system that is capable of integrating both rule-based and statistical machine learning based approaches. Our system utilizes UMLS to extract clinically relevant features from the unstructured text…

Computation and Language · Computer Science 2018-07-19 Himanshu Sharma , Chengsheng Mao , Yizhen Zhang , Haleh Vatani , Liang Yao , Yizhen Zhong , Luke Rasmussen , Guoqian Jiang , Jyotishman Pathak , Yuan Luo

Clinical trial eligibility matching is a critical yet often labor-intensive and error-prone step in medical research, as it ensures that participants meet precise criteria for safe and reliable study outcomes. Recent advances in Natural…

Machine Learning · Computer Science 2025-03-04 Muhammad Talha Sharif , Abdul Rehman

Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requirement for low-error and high-quality labels necessary for…

Computation and Language · Computer Science 2026-03-24 Antonio Purificato , Maria Sofia Bucarelli , Andrea Bacciu , Amin Mantrach , Fabrizio Silvestri

Recent advances in word embeddings and language models use large-scale, unlabelled data and self-supervised learning to boost NLP performance. Multilingual models, often trained on web-sourced data like Wikipedia, face challenges: few…

Computation and Language · Computer Science 2025-07-02 David Ifeoluwa Adelani