English
Related papers

Related papers: CEHR-BERT: Incorporating temporal information from…

200 papers

This study proposes a Transformer-based longitudinal modeling method to address challenges in clinical risk classification with heterogeneous Electronic Health Record (EHR) data, including irregular temporal patterns, large modality…

Machine Learning · Computer Science 2025-11-07 Anzhuo Xie , Wei-Chen Chang

Electronic health records (EHR) are increasingly being used for constructing disease risk prediction models. Feature engineering in EHR data however is challenging due to their highly dimensional and heterogeneous nature. Low-dimensional…

Computation and Language · Computer Science 2018-11-29 Spiros Denaxas , Pontus Stenetorp , Sebastian Riedel , Maria Pikoula , Richard Dobson , Harry Hemingway

Electronic health records (EHR) are widely believed to hold a profusion of actionable insights, encrypted in an irregular, semi-structured format, amidst a loud noise background. To simplify learning patterns of health and disease, medical…

Computation and Language · Computer Science 2022-12-13 David A. Bloore , Romane Gauriau , Anna L. Decker , Jacob Oppenheim

Longitudinal data in electronic health records (EHRs) represent an individual`s clinical history through a sequence of codified concepts, including diagnoses, procedures, medications, and laboratory tests. Generative pre-trained…

Predicting disease trajectories from electronic health records (EHRs) is a complex task due to major challenges such as data non-stationarity, high granularity of medical codes, and integration of multimodal data. EHRs contain both…

Machine Learning · Computer Science 2025-02-26 Sifal Klioui , Sana Sellami , Youssef Trardi

Contextualized word embeddings have demonstrated state-of-the-art performance in various natural language processing tasks including those that concern historical semantic change. However, language models such as BERT was trained primarily…

Computation and Language · Computer Science 2022-02-10 Wenjun Qiu , Yang Xu

Deep learning-based predictive models, leveraging Electronic Health Records (EHR), are receiving increasing attention in healthcare. An effective representation of a patient's EHR should hierarchically encompass both the temporal…

Machine Learning · Computer Science 2024-05-08 Jiayuan Chen , Changchang Yin , Yuanlong Wang , Ping Zhang

The recently proposed BERT has shown great power on a variety of natural language understanding tasks, such as text classification, reading comprehension, etc. However, how to effectively apply BERT to neural machine translation (NMT) lacks…

Computation and Language · Computer Science 2020-02-18 Jinhua Zhu , Yingce Xia , Lijun Wu , Di He , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

Building models for health prediction based on Electronic Health Records (EHR) has become an active research area. EHR patient journey data consists of patient time-ordered clinical events/visits from patients. Most existing studies focus…

Machine Learning · Computer Science 2022-07-18 Yuxi Liu , Zhenhao Zhang , Antonio Jimeno Yepes , Flora D. Salim

Integrating multimodal Electronic Health Records (EHR) data, such as numerical time series and free-text clinical reports, has great potential in predicting clinical outcomes. However, prior work has primarily focused on capturing temporal…

Machine Learning · Computer Science 2025-11-10 Fuying Wang , Feng Wu , Yihan Tang , Lequan Yu

Electronic Health Records (EHRs), the digital representation of a patient's medical history, are a valuable resource for epidemiological and clinical research. They are also becoming increasingly complex, with recent trends indicating…

Machine Learning · Computer Science 2025-08-19 Rachael DeVries , Casper Christensen , Marie Lisandra Zepeda Mendoza , Ole Winther

Clinical decision support tools built on electronic health records often experience performance drift due to temporal population shifts, particularly when changes in the clinical environment initially affect only a subset of patients,…

Machine Learning · Computer Science 2025-12-16 Mengying Yan , Ziye Tian , Siqi Li , Nan Liu , Benjamin A. Goldstein , Molei Liu , Chuan Hong

With the recent availability of Electronic Health Records (EHR) and great opportunities they offer for advancing medical informatics, there has been growing interest in mining EHR for improving quality of care. Disease diagnosis due to its…

Artificial Intelligence · Computer Science 2018-04-24 Anahita Hosseini , Ting Chen , Wenjun Wu , Yizhou Sun , Majid Sarrafzadeh

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information extraction and text…

Computation and Language · Computer Science 2020-11-13 Kexin Huang , Sankeerth Garapati , Alexander S. Rich

Identification of key variables such as medications, diseases, relations from health records and clinical notes has a wide range of applications in the clinical domain. n2c2 2022 provided shared tasks on challenges in natural language…

Computation and Language · Computer Science 2025-07-01 Shouvon Sarker , Xishuang Dong , Lijun Qian

Although deep learning has advanced automated electrocardiogram (ECG) diagnosis, prevalent supervised methods typically treat recordings as undifferentiated one-dimensional (1D) signals or two-dimensional (2D) images. This formulation…

Machine Learning · Computer Science 2026-01-13 Runze Ma , Caizhi Liao

As hospitals move towards automating and integrating their computing systems, more fine-grained hospital operations data are becoming available. These data include hospital architectural drawings, logs of interactions between patients and…

Machine Learning · Computer Science 2023-03-22 Hankyu Jang , Sulyun Lee , D. M. Hasibul Hasan , Philip M. Polgreen , Sriram V. Pemmaraju , Bijaya Adhikari

The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture…

Machine Learning · Computer Science 2025-04-11 Yuanyun Zhang , Shi Li

Transformer-based models have improved predictive modeling on longitudinal electronic health records through large-scale self-supervised pretraining. However, most EHR transformer architectures treat each clinical encounter as an unordered…

Machine Learning · Computer Science 2026-03-17 Krish Tadigotla

The objective of this work is to develop an Electronic Medical Record (EMR) data processing tool that confers clinical context to Machine Learning (ML) algorithms for error handling, bias mitigation and interpretability. We present…