English
Related papers

Related papers: An Analysis of Attention over Clinical Notes for P…

200 papers

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information extraction and text…

Computation and Language · Computer Science 2020-11-13 Kexin Huang , Sankeerth Garapati , Alexander S. Rich

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For…

Machine Learning · Computer Science 2021-04-01 Alana de Santana Correia , Esther Luna Colombini

The widespread adoption of Electronic Health Records (EHR) has significantly increased the amount of available healthcare data. This has allowed models inspired by Natural Language Processing (NLP) and Computer Vision, which scale…

Unstructured Electronic Health Record (EHR) data, such as clinical notes, contain clinical contextual observations that are not directly reflected in structured data fields. This additional information can substantially improve model…

Machine Learning · Computer Science 2026-03-25 Zigui Wang , Minghui Sun , Jiang Shu , Matthew M. Engelhard , Lauren Franz , Benjamin A. Goldstein

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

The work discusses the use of machine learning algorithms for anomaly detection in medical image analysis and how the performance of these algorithms depends on the number of annotators and the quality of labels. To address the issue of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Hieu H. Pham , Khiem H. Le , Tuan V. Tran , Ha Q. Nguyen

This paper explores the advancements and applications of language models in healthcare, focusing on their clinical use cases. It examines the evolution from early encoder-based systems requiring extensive fine-tuning to state-of-the-art…

Artificial Intelligence · Computer Science 2025-05-12 Nikita Neveditsin , Pawan Lingras , Vijay Mago

Electronic phenotyping is the task of ascertaining whether an individual has a medical condition of interest by analyzing their medical record and is foundational in clinical informatics. Increasingly, electronic phenotyping is performed…

Machine Learning · Statistics 2019-01-08 Daisy Yi Ding , Chloé Simpson , Stephen Pfohl , Dave C. Kale , Kenneth Jung , Nigam H. Shah

With the increase of the Electronic Health Records (EHR) data, more and more researchers are developing machine learning models to learn from the medical notes. These unstructured text data pose significant challenges on the learning…

Machine Learning · Computer Science 2026-05-06 Zijiang Yang

Clinical notes are becoming an increasingly important data source for machine learning (ML) applications in healthcare. Prior research has shown that deploying ML models can perpetuate existing biases against racial minorities, as bias can…

Electronic health record (EHR) data is sparse and irregular as it is recorded at irregular time intervals, and different clinical variables are measured at each observation point. In this work, we propose a multi-view features integration…

Machine Learning · Computer Science 2021-01-27 Yurim Lee , Eunji Jun , Heung-Il Suk

The surging availability of electronic medical records (EHR) leads to increased research interests in medical predictive modeling. Recently many deep learning based predicted models are also developed for EHR data and demonstrated…

Machine Learning · Computer Science 2018-02-15 Mengying Sun , Fengyi Tang , Jinfeng Yi , Fei Wang , Jiayu Zhou

Electronic health record (EHR) data are becoming an increasingly common data source for understanding clinical risk of acute events. While their longitudinal nature presents opportunities to observe changing risk over time, these analyses…

Leveraging knowledge from electronic health records (EHRs) to predict a patient's condition is essential to the effective delivery of appropriate care. Clinical notes of patient EHRs contain valuable information from healthcare…

Computation and Language · Computer Science 2023-05-18 Nayeon Kim , Yinhua Piao , Sun Kim

In neuroscience, attention has been shown to bidirectionally interact with reinforcement learning (RL) processes. This interaction is thought to support dimensionality reduction of task representations, restricting computations to relevant…

Artificial Intelligence · Computer Science 2020-07-14 Lennart Bramlage , Aurelio Cortese

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu

We have three contributions in this work: 1. We explore the utility of a stacked denoising autoencoder and a paragraph vector model to learn task-independent dense patient representations directly from clinical notes. To analyze if these…

Computation and Language · Computer Science 2018-07-05 Madhumita Sushil , Simon Šuster , Kim Luyckx , Walter Daelemans

Decision support systems based on clinical notes have the potential to improve patient care by pointing doctors towards overseen risks. Predicting a patient's outcome is an essential part of such systems, for which the use of deep neural…

Computation and Language · Computer Science 2021-12-01 Betty van Aken , Sebastian Herrmann , Alexander Löser

Effective representation learning of electronic health records is a challenging task and is becoming more important as the availability of such data is becoming pervasive. The data contained in these records are irregular and contain…

Machine Learning · Computer Science 2020-05-05 Sajad Darabi , Mohammad Kachuee , Shayan Fazeli , Majid Sarrafzadeh