English
Related papers

Related papers: Bi-Axial Transformers: Addressing the Increasing C…

200 papers

Domain-specific foundation models for healthcare have expanded rapidly in recent years, yet foundation models for critical care time series remain relatively underexplored due to the limited size and availability of datasets. In this work,…

Machine Learning · Computer Science 2025-09-25 Katja Naasunnguaq Jagd , Rachael DeVries , Ole Winther

Transformer-based models have improved predictive modeling on longitudinal electronic health records through large-scale self-supervised pretraining. However, most EHR transformer architectures treat each clinical encounter as an unordered…

Machine Learning · Computer Science 2026-03-17 Krish Tadigotla

Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical…

Information Retrieval · Computer Science 2019-08-12 Zongcheng Ji , Qiang Wei , Hua Xu

Embedding algorithms are increasingly used to represent clinical concepts in healthcare for improving machine learning tasks such as clinical phenotyping and disease prediction. Recent studies have adapted state-of-the-art bidirectional…

Machine Learning · Computer Science 2021-12-07 Chao Pang , Xinzhuo Jiang , Krishna S Kalluri , Matthew Spotnitz , RuiJun Chen , Adler Perotte , Karthik Natarajan

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson

The widespread adoption of Electronic Health Records (EHR) has significantly increased the amount of available healthcare data. This has allowed models inspired by Natural Language Processing (NLP) and Computer Vision, which scale…

Deep learning-based predictive models, leveraging Electronic Health Records (EHR), are receiving increasing attention in healthcare. An effective representation of a patient's EHR should hierarchically encompass both the temporal…

Machine Learning · Computer Science 2024-05-08 Jiayuan Chen , Changchang Yin , Yuanlong Wang , Ping Zhang

Irregular sampling of time series in electronic health records (EHRs) is one of the main challenges for developing machine learning models. Additionally, the pattern of missing data in certain clinical variables is not at random but depends…

Machine Learning · Computer Science 2024-06-17 Hojjat Karami , David Atienza , Anisoara Ionescu

Augmentation of disease diagnosis and decision-making in healthcare with machine learning algorithms is gaining much impetus in recent years. In particular, in the current epidemiological situation caused by COVID-19 pandemic, swift and…

Computers and Society · Computer Science 2021-02-23 Leopold Franz , Yash Raj Shrestha , Bibek Paudel

We introduce HTAD, a novel model for diagnosis prediction using Electronic Health Records (EHR) represented as Heterogeneous Information Networks. Recent studies on modeling EHR have shown success in automatically learning representations…

Machine Learning · Computer Science 2019-12-24 Anahita Hosseini , Tyler Davis , Majid Sarrafzadeh

Electronic Health Records (EHRs) aggregate diverse information at the patient level, holding a trajectory representative of the evolution of the patient health status throughout time. Although this information provides context and can be…

Machine Learning · Computer Science 2022-09-12 João Figueira Silva , Sérgio Matos

Electronic health record (EHR) data has emerged as a valuable resource for analyzing patient health status. However, the prevalence of missing data in EHR poses significant challenges to existing methods, leading to spurious correlations…

Machine Learning · Computer Science 2024-05-16 Zhihao Yu , Xu Chu , Yujie Jin , Yasha Wang , Junfeng Zhao

The emergence of foundation models in healthcare has opened new avenues for learning generalizable representations from large scale clinical data. Yet, existing approaches often struggle to reconcile the tabular and event based nature of…

Computation and Language · Computer Science 2025-10-17 Zhirong Chou , Quan Qin , Shi Li

Despite the growing availability of Electronic Health Record (EHR) data, researchers often face substantial barriers in effectively using these data for translational research due to their complexity, heterogeneity, and lack of standardized…

Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used…

Machine Learning · Computer Science 2019-09-23 Wei-Hung Weng , Peter Szolovits

The presence of detailed clinical information in electronic health record (EHR) systems presents promising prospects for enhancing patient care through automated retrieval techniques. Nevertheless, it is widely acknowledged that accessing…

Information Retrieval · Computer Science 2024-09-13 Abderrahim Oussama Batouche , Eugen Czeizler , Miika Koskinen , Tuomas Mirtti , Antti Sakari Rannikko

The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture…

Machine Learning · Computer Science 2025-04-11 Yuanyun Zhang , Shi Li

The wide implementation of electronic health record (EHR) systems facilitates the collection of large-scale health data from real clinical settings. Despite the significant increase in adoption of EHR systems, this data remains largely…

Quantitative Methods · Quantitative Biology 2018-10-26 Jinghe Zhang , Kamran Kowsari , James H. Harrison , Jennifer M. Lobo , Laura E. Barnes

Transformer-based deep learning models have shown promise for disease risk prediction using electronic health records(EHRs), but modeling temporal dependencies remains a key challenge due to irregular visit intervals and lack of uniform…

Machine Learning · Computer Science 2025-11-10 Daniel S. Lee , Mayra S. Haedo-Cruz , Chen Jiang , Oshin Miranda , LiRong Wang

Using electronic health records data and machine learning to guide future decisions needs to address challenges, including 1) long/short-term dependencies and 2) interactions between diseases and interventions. Bidirectional transformers…

Machine Learning · Computer Science 2024-02-13 Ali Amirahmadi , Mattias Ohlsson , Kobra Etminani , Olle Melander , Jonas Björk