English
Related papers

Related papers: ClinicalBERT: Modeling Clinical Notes and Predicti…

200 papers

The objective of this study is to develop natural language processing (NLP) models that can analyze patients' drug reviews and accurately classify their satisfaction levels as positive, neutral, or negative. Such models would reduce the…

Computation and Language · Computer Science 2023-08-09 Yue Ling

Clinical trials offer a fundamental opportunity to discover new treatments and advance the medical knowledge. However, the uncertainty of the outcome of a trial can lead to unforeseen costs and setbacks. In this study, we propose a new…

Computation and Language · Computer Science 2022-04-04 Georgios Katsimpras , Georgios Paliouras

We present a system that uses a learned autocompletion mechanism to facilitate rapid creation of semi-structured clinical documentation. We dynamically suggest relevant clinical concepts as a doctor drafts a note by leveraging features from…

Machine Learning · Computer Science 2020-07-31 Divya Gopinath , Monica Agrawal , Luke Murray , Steven Horng , David Karger , David Sontag

In recent times, denoising diffusion probabilistic models (DPMs) have proven effective for medical image generation and denoising, and as representation learners for downstream segmentation. However, segmentation performance is limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Venkata Siddharth Dhara , Pawan Kumar

Transformer neural networks, particularly Bidirectional Encoder Representations from Transformers (BERT), have shown remarkable performance across various tasks such as classification, text summarization, and question answering. However,…

Machine Learning · Computer Science 2025-02-18 Matteo Bonino , Giorgia Ghione , Giansalvo Cirrincione

In this work, we test the performance of two bidirectional transformer-based language models, BERT and SpanBERT, on predicting directionality in causal pairs in the textual content. Our preliminary results show that predicting direction for…

Computation and Language · Computer Science 2021-03-26 Pedram Hosseini , David A. Broniatowski , Mona Diab

In this paper, we address the challenge of patient-note identification, which involves accurately matching an anonymized clinical note to its corresponding patient, represented by a set of related notes. This task has broad applications,…

Computation and Language · Computer Science 2025-04-01 Safa Alsaidi , Marc Vincent , Olivia Boyer , Nicolas Garcelon , Miguel Couceiro , Adrien Coulet

Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical…

Quantitative Methods · Quantitative Biology 2021-10-20 Xiong Liu , Greg L. Hersch , Iya Khalil , Murthy Devarakonda

Clinical foundation models are evaluated with factual or exam-style medical QA, but treatment decisions must change when patient context changes. We introduce ClinPivot, an auditable treatment-decision benchmark built from biomedical…

Artificial Intelligence · Computer Science 2026-05-28 Dongkyu Cho , Miao Zhang , Rumi Chunara

This paper conducts a comprehensive investigation into applying large language models, particularly on BioBERT, in healthcare. It begins with thoroughly examining previous natural language processing (NLP) approaches in healthcare, shedding…

Artificial Intelligence · Computer Science 2023-10-13 Shyni Sharaf , V. S. Anoop

Predicting patient mortality is an important and challenging problem in the healthcare domain, especially for intensive care unit (ICU) patients. Electronic health notes serve as a rich source for learning patient representations, that can…

Computation and Language · Computer Science 2019-10-16 Shaika Chowdhury , Chenwei Zhang , Philip S. Yu , Yuan Luo

Background Clinical studies using real-world data may benefit from exploiting clinical reports, a particularly rich albeit unstructured medium. To that end, natural language processing can extract relevant information. Methods based on…

Computation and Language · Computer Science 2022-07-27 Basile Dura , Charline Jean , Xavier Tannier , Alice Calliger , Romain Bey , Antoine Neuraz , Rémi Flicoteaux

With the growing amount of text in health data, there have been rapid advances in large pre-trained models that can be applied to a wide variety of biomedical tasks with minimal task-specific modifications. Emphasizing the cost of these…

This research on data extraction methods applies recent advances in natural language processing to evidence synthesis based on medical texts. Texts of interest include abstracts of clinical trials in English and in multilingual contexts.…

Computation and Language · Computer Science 2020-01-31 Lena Schmidt , Julie Weeds , Julian P. T. Higgins

Electronic Health Records (EHRs) aggregate diverse information at the patient level, holding a trajectory representative of the evolution of the patient health status throughout time. Although this information provides context and can be…

Machine Learning · Computer Science 2022-09-12 João Figueira Silva , Sérgio Matos

Extracting phenotypes from clinical text has been shown to be useful for a variety of clinical use cases such as identifying patients with rare diseases. However, reasoning with numerical values remains challenging for phenotyping in…

Computation and Language · Computer Science 2022-04-22 Ashwani Tanwar , Jingqing Zhang , Julia Ive , Vibhor Gupta , Yike Guo

Due to the compelling improvements brought by BERT, many recent representation models adopted the Transformer architecture as their main building block, consequently inheriting the wordpiece tokenization system despite it not being…

Computation and Language · Computer Science 2020-11-03 Hicham El Boukkouri , Olivier Ferret , Thomas Lavergne , Hiroshi Noji , Pierre Zweigenbaum , Junichi Tsujii

Identification of key variables such as medications, diseases, relations from health records and clinical notes has a wide range of applications in the clinical domain. n2c2 2022 provided shared tasks on challenges in natural language…

Computation and Language · Computer Science 2025-07-01 Shouvon Sarker , Xishuang Dong , Lijun Qian

The purpose of the study is to investigate the relative effectiveness of four different sentiment analysis techniques: (1) unsupervised lexicon-based model using Sent WordNet; (2) traditional supervised machine learning model using logistic…

Computation and Language · Computer Science 2020-07-03 Shivaji Alaparthi , Manit Mishra

Unplanned intensive care unit (ICU) readmission rate is an important metric for evaluating the quality of hospital care. Efficient and accurate prediction of ICU readmission risk can not only help prevent patients from inappropriate…

Computation and Language · Computer Science 2022-01-10 Qiuhao Lu , Thien Huu Nguyen , Dejing Dou