English
Related papers

Related papers: Building the EHR Foundation Model via Next Event P…

200 papers

Predicting health risks from electronic health records (EHR) is a topic of recent interest. Deep learning models have achieved success by modeling temporal and feature interaction. However, these methods learn insufficient representations…

Machine Learning · Computer Science 2023-12-19 Zhihao Yu , Chaohe Zhang , Yasha Wang , Wen Tang , Jiangtao Wang , Liantao Ma

Rich Electronic Health Records (EHR), have created opportunities to improve clinical processes using machine learning methods. Prediction of the same patient events at different time horizons can have very different applications and…

Machine Learning · Computer Science 2023-03-07 Hao Liu , Muhan Zhang , Zehao Dong , Lecheng Kong , Yixin Chen , Bradley Fritz , Dacheng Tao , Christopher King

While large-scale pretraining has revolutionized language modeling, its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present RAVEN, a novel generative pretraining strategy for sequential…

Background: Natural Language Processing (NLP) is widely used to extract clinical insights from Electronic Health Records (EHRs). However, the lack of annotated data, automated tools, and other challenges hinder the full utilisation of NLP…

Computation and Language · Computer Science 2023-06-23 Elias Hossain , Rajib Rana , Niall Higgins , Jeffrey Soar , Prabal Datta Barua , Anthony R. Pisani , Ph. D , Kathryn Turner}

Analysis of longitudinal Electronic Health Record (EHR) data is an important goal for precision medicine. Difficulty in applying Machine Learning (ML) methods, either predictive or unsupervised, stems in part from the heterogeneity and…

Quantitative Methods · Quantitative Biology 2022-04-18 Alan D. Kaplan , Uttara Tipnis , Jean C. Beckham , Nathan A. Kimbrel , David W. Oslin , Benjamin H. McMahon

Machine learning (ML) has recently shown promising results in medical predictions using electronic health records (EHRs). However, since ML models typically have a limited capability in terms of input sizes, selecting specific medical…

Machine Learning · Computer Science 2024-07-23 Junu Kim , Chaeeun Shim , Bosco Seong Kyu Yang , Chami Im , Sung Yoon Lim , Han-Gil Jeong , Edward Choi

Structured Electronic Health Record (EHR) data stores patient information in relational tables and plays a central role in clinical decision-making. Recent advances have explored the use of large language models (LLMs) to process such data,…

Artificial Intelligence · Computer Science 2026-04-02 Xiao Yang , Xuejiao Zhao , Zhiqi Shen

Advanced epidemic forecasting is critical for enabling precision containment strategies, highlighting its strategic importance for public health security. While recent advances in Large Language Models (LLMs) have demonstrated effectiveness…

Machine Learning · Computer Science 2025-05-20 Chenghua Gong , Rui Sun , Yuhao Zheng , Juyuan Zhang , Tianjun Gu , Liming Pan , Linyuan Lv

Event relations are crucial for narrative understanding and reasoning. Governed by nuanced logic, event relation extraction (ERE) is a challenging task that demands thorough semantic understanding and rigorous logical reasoning. In this…

Artificial Intelligence · Computer Science 2024-08-12 Meiqi Chen , Yubo Ma , Kaitao Song , Yixin Cao , Yan Zhang , Dongsheng Li

Clinical language models have achieved strong performance on downstream tasks by pretraining on domain specific corpora such as discharge summaries and medical notes. However, most approaches treat the electronic health record as a static…

Computation and Language · Computer Science 2025-04-28 Tatsunori Tanaka , Fi Zheng , Kai Sato , Zhifeng Li , Yuanyun Zhang , Shi Li

Artificial intelligence (AI) has demonstrated significant potential in transforming healthcare through the analysis and modeling of electronic health records (EHRs). However, the inherent heterogeneity, temporal irregularity, and…

Machine Learning · Computer Science 2025-07-18 Weijieying Ren , Jingxi Zhu , Zehao Liu , Tianxiang Zhao , Vasant Honavar

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

World models offer a principled framework for simulating future states under interventions, but realizing such models in complex, high-stakes domains like medicine remains challenging. Recent large language models (LLMs) have achieved…

Artificial Intelligence · Computer Science 2026-02-04 Linjie Mu , Zhongzhen Huang , Yannian Gu , Shengqian Qin , Shaoting Zhang , Xiaofan Zhang

Sequence labeling for extraction of medical events and their attributes from unstructured text in Electronic Health Record (EHR) notes is a key step towards semantic understanding of EHRs. It has important applications in health informatics…

Computation and Language · Computer Science 2016-07-13 Abhyuday Jagannatha , Hong Yu

Widespread adoption of electronic health records (EHRs) has fueled the development of using machine learning to build prediction models for various clinical outcomes. This process is often constrained by having a relatively small number of…

Computation and Language · Computer Science 2020-05-14 Ethan Steinberg , Ken Jung , Jason A. Fries , Conor K. Corbin , Stephen R. Pfohl , Nigam H. Shah

Deep Learning based models are currently dominating most state-of-the-art solutions for disease prediction. Existing works employ RNNs along with multiple levels of attention mechanisms to provide interpretability. These deep learning…

Machine Learning · Statistics 2022-06-01 Subhadip Maji , Raghav Bali , Sree Harsha Ankem , Kishore V Ayyadevara

The development of electronic health records (EHR) systems has enabled the collection of a vast amount of digitized patient data. However, utilizing EHR data for predictive modeling presents several challenges due to its unique…

Machine Learning · Computer Science 2024-08-14 Jiaqi Wang , Junyu Luo , Muchao Ye , Xiaochen Wang , Yuan Zhong , Aofei Chang , Guanjie Huang , Ziyi Yin , Cao Xiao , Jimeng Sun , Fenglong Ma

Predicting future clinical outcomes from electronic health records (EHR) remains challenging due to the complexity and heterogeneity of patient data. LLMs have shown strong potential for such predictive tasks, yet existing approaches mainly…

Computation and Language · Computer Science 2026-05-05 Yushi Cao , Yiming Chen , Hongchao Jiang , Hung-yi Lee , Robby T. Tan

Electronic health record (EHR) foundation models have been an area ripe for exploration with their improved performance in various medical tasks. Despite the rapid advances, there exists a fundamental limitation: Processing unseen medical…

Artificial Intelligence · Computer Science 2025-08-15 Junmo Kim , Namkyeong Lee , Jiwon Kim , Kwangsoo Kim

We address the problem of predicting when a disease will develop, i.e., medical event time (MET), from a patient's electronic health record (EHR). The MET of non-communicable diseases like diabetes is highly correlated to cumulative health…

Machine Learning · Computer Science 2023-06-01 Takayuki Katsuki , Kohei Miyaguchi , Akira Koseki , Toshiya Iwamori , Ryosuke Yanagiya , Atsushi Suzuki