English
Related papers

Related papers: Improved Hierarchical Patient Classification with …

200 papers

Recent years have seen particular interest in using electronic medical records (EMRs) for secondary purposes to enhance the quality and safety of healthcare delivery. EMRs tend to contain large amounts of valuable clinical notes. Learning…

Computation and Language · Computer Science 2022-07-25 Hoda Memarzadeh , Nasser Ghadiri , Maryam Lotfi Shahreza

Clinical notes containing valuable patient information are written by different health care providers with various scientific levels and writing styles. It might be helpful for clinicians and researchers to understand what information is…

Computation and Language · Computer Science 2023-03-17 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Deep learning models (aka Deep Neural Networks) have revolutionized many fields including computer vision, natural language processing, speech recognition, and is being increasingly used in clinical healthcare applications. However, few…

Machine Learning · Computer Science 2017-10-25 Sanjay Purushotham , Chuizheng Meng , Zhengping Che , Yan Liu

We have three contributions in this work: 1. We explore the utility of a stacked denoising autoencoder and a paragraph vector model to learn task-independent dense patient representations directly from clinical notes. To analyze if these…

Computation and Language · Computer Science 2018-07-05 Madhumita Sushil , Simon Šuster , Kim Luyckx , Walter Daelemans

We propose an approach for adapting the DeBERTa model for electronic health record (EHR) tasks using domain adaptation. We pretrain a small DeBERTa model on a dataset consisting of MIMIC-III discharge summaries, clinical notes, radiology…

Computation and Language · Computer Science 2023-03-28 Christopher McMaster , David FL Liew , Douglas EV Pires

Recent years have witnessed increasing interests in developing interpretable models in Natural Language Processing (NLP). Most existing models aim at identifying input features such as words or phrases important for model predictions.…

Computation and Language · Computer Science 2022-08-10 Hanqi Yan , Lin Gui , Yulan He

Clinical language models are important for many applications in healthcare, but their development depends on access to extensive clinical text for pretraining. However, obtaining clinical notes from electronic health records (EHRs) at scale…

Computation and Language · Computer Science 2024-12-02 Jinghui Liu , Anthony Nguyen

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

Computers and Society · Computer Science 2019-12-03 Benjamin Clavié , Kobi Gal

The field of clinical natural language processing has been advanced significantly since the introduction of deep learning models. The self-supervised representation learning and the transfer learning paradigm became the methods of choice in…

Computation and Language · Computer Science 2020-04-27 Andrey Kormilitzin , Nemanja Vaci , Qiang Liu , Alejo Nevado-Holgado

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health systems.…

Computation and Language · Computer Science 2020-09-18 Andriy Mulyar , Elliot Schumacher , Masoud Rouhizadeh , Mark Dredze

Automated analysis of clinical notes is attracting increasing attention. However, there has not been much work on medical term abbreviation disambiguation. Such abbreviations are abundant, and highly ambiguous, in clinical documents. One of…

Computation and Language · Computer Science 2019-11-01 Irene Li , Michihiro Yasunaga , Muhammed Yavuz Nuzumlalı , Cesar Caraballo , Shiwani Mahajan , Harlan Krumholz , Dragomir Radev

We introduce HTAD, a novel model for diagnosis prediction using Electronic Health Records (EHR) represented as Heterogeneous Information Networks. Recent studies on modeling EHR have shown success in automatically learning representations…

Machine Learning · Computer Science 2019-12-24 Anahita Hosseini , Tyler Davis , Majid Sarrafzadeh

Clinical notes are an efficient way to record patient information but are notoriously hard to decipher for non-experts. Automatically simplifying medical text can empower patients with valuable information about their health, while saving…

Clinical notes are often stored in unstructured or semi-structured formats after extraction from electronic medical record (EMR) systems, which complicates their use for secondary analysis and downstream clinical applications. Reliable…

Computation and Language · Computer Science 2025-12-30 Risha Surana , Adrian Law , Sunwoo Kim , Rishab Sridhar , Angxiao Han , Peiyu Hong

Hierarchical neural architectures are often used to capture long-distance dependencies and have been applied to many document-level tasks such as summarization, document segmentation, and sentiment analysis. However, effective usage of such…

Computation and Language · Computer Science 2019-01-29 Ming-Wei Chang , Kristina Toutanova , Kenton Lee , Jacob Devlin

Accurate mortality prediction allows Intensive Care Units (ICUs) to adequately benchmark clinical practice and identify patients with unexpected outcomes. Traditionally, simple statistical models have been used to assess patient death risk,…

Machine Learning · Computer Science 2020-05-20 William Caicedo-Torres , Jairo Gutierrez

Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks. However, in the medical domain, existing pretrained models on electronic health records…

Artificial Intelligence · Computer Science 2023-10-23 Xiaochen Wang , Junyu Luo , Jiaqi Wang , Ziyi Yin , Suhan Cui , Yuan Zhong , Yaqing Wang , Fenglong Ma

Clinical notes contain unstructured text provided by clinicians during patient encounters. These notes are usually accompanied by a sequence of diagnostic codes following the International Classification of Diseases (ICD). Correctly…

Machine Learning · Computer Science 2025-10-17 Mohammad Mansoori , Amira Soliman , Farzaneh Etminani

Outcome prediction from clinical text can prevent doctors from overlooking possible risks and help hospitals to plan capacities. We simulate patients at admission time, when decision support can be especially valuable, and contribute a…

Computation and Language · Computer Science 2021-02-09 Betty van Aken , Jens-Michalis Papaioannou , Manuel Mayrdorfer , Klemens Budde , Felix A. Gers , Alexander Löser

Electronic Health Records have become popular sources of data for secondary research, but their use is hampered by the amount of effort it takes to overcome the sparsity, irregularity, and noise that they contain. Modern learning…

Applications · Statistics 2025-02-28 Jacek M. Bajor , Diego A. Mesa , Travis J. Osterman , Thomas A. Lasko