English
Related papers

Related papers: Foundation models for electronic health records: r…

200 papers

The hypothesis that computational models can be reliable enough to be adopted in prognosis and patient care is revolutionizing healthcare. Deep learning, in particular, has been a game changer in building predictive models, thus leading to…

Machine Learning · Statistics 2019-06-17 Jayaraman J. Thiagarajan , Deepta Rajan , Prasanna Sattigeri

Large-scale pretraining has transformed modeling of language and other data types, but its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present a novel generative pretraining strategy…

Foundation model, which is pre-trained on broad data and is able to adapt to a wide range of tasks, is advancing healthcare. It promotes the development of healthcare artificial intelligence (AI) models, breaking the contradiction between…

Computers and Society · Computer Science 2024-04-05 Yuting He , Fuxiang Huang , Xinrui Jiang , Yuxiang Nie , Minghao Wang , Jiguang Wang , Hao Chen

The lack of standardized evaluation benchmarks in the medical domain for text inputs can be a barrier to widely adopting and leveraging the potential of natural language models for health-related downstream tasks. This paper revisited an…

Computation and Language · Computer Science 2025-04-30 Jesus Lovon , Thouria Ben-Haddi , Jules Di Scala , Jose G. Moreno , Lynda Tamine

Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare…

Machine Learning · Computer Science 2018-10-24 Edward Choi , Cao Xiao , Walter F. Stewart , Jimeng Sun

Electronic health records (EHRs) are rich clinical data sources but complex repositories of patient data, spanning structured elements (demographics, vitals, lab results, codes), unstructured clinical notes and other modalities of data.…

Artificial Intelligence · Computer Science 2025-08-25 Sonish Sivarajkumar , Hang Zhang , Yuelyu Ji , Maneesh Bilalpur , Xizhi Wu , Chenyu Li , Min Gu Kwak , Shyam Visweswaran , Yanshan Wang

Wearable foundation models (WFMs), trained on large volumes of data collected by affordable, always-on devices, have demonstrated strong performance on short-term, well-defined health monitoring tasks, including activity recognition,…

Machine Learning · Computer Science 2026-03-23 Yu Yvonne Wu , Yuwei Zhang , Hyungjun Yoon , Ting Dang , Dimitris Spathis , Tong Xia , Qiang Yang , Jing Han , Dong Ma , Sung-Ju Lee , Cecilia Mascolo

Accurate disease trajectory prediction is critical for early intervention, resource allocation, and improving long-term outcomes. While electronic health records (EHRs) provide a rich longitudinal view of patient health in clinical…

Machine Learning · Computer Science 2026-05-15 Yunying Zhu , Andrew R Weckstein , Kueiyu Joshua Lin , Jie Yang

Electronic Health Records (EHRs) contain a wealth of patient data; however, the sparsity of EHRs data often presents significant challenges for predictive modeling. Conventional imputation methods inadequately distinguish between real and…

Machine Learning · Computer Science 2025-02-27 Yinghao Zhu , Zixiang Wang , Long He , Shiyun Xie , Xiaochen Zheng , Liantao Ma , Chengwei Pan

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

The advent of foundation models (FMs) as an emerging suite of AI techniques has struck a wave of opportunities in computational healthcare. The interactive nature of these models, guided by pre-training data and human instructions, has…

Machine Learning · Computer Science 2026-04-30 Yunkun Zhang , Jin Gao , Zheling Tan , Lingfeng Zhou , Kexin Ding , Mu Zhou , Shaoting Zhang , Dequan Wang

Widespread adoption of electronic health records (EHRs) has fueled the development of using machine learning to build prediction models for various clinical outcomes. This process is often constrained by having a relatively small number of…

Computation and Language · Computer Science 2020-05-14 Ethan Steinberg , Ken Jung , Jason A. Fries , Conor K. Corbin , Stephen R. Pfohl , Nigam H. Shah

Foundation models trained on large-scale de-identified electronic health records (EHRs) hold promise for clinical applications. However, their capacity to memorize patient information raises important privacy concerns. In this work, we…

Machine Learning · Computer Science 2025-10-16 Sana Tonekaboni , Lena Stempfle , Adibvafa Fallahpour , Walter Gerych , Marzyeh Ghassemi

Recent years have seen particular interest in using electronic medical records (EMRs) for secondary purposes to enhance the quality and safety of healthcare delivery. EMRs tend to contain large amounts of valuable clinical notes. Learning…

Computation and Language · Computer Science 2022-07-25 Hoda Memarzadeh , Nasser Ghadiri , Maryam Lotfi Shahreza

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Electronic Health Records (EHR) data contains medical records such as diagnoses, medications, procedures, and treatments of patients. This data is often considered sensitive medical information. Therefore, the EHR data from the medical…

Machine Learning · Computer Science 2023-05-25 Ofir Ben Shoham , Nadav Rappoport

Hospitals struggle to predict critical outcomes. Traditional early warning systems, like NEWS and MEWS, rely on static variables and fixed thresholds, limiting their adaptability, accuracy, and personalization. We previously developed the…

When training clinical prediction models from electronic health records (EHRs), a key concern should be a model's ability to sustain performance over time when deployed, even as care practices, database systems, and population demographics…

Electronic Health Records (EHRs) offer considerable potential for clinical prediction, but their complexity and heterogeneity challenge traditional machine learning. Domain-specific EHR foundation models trained on unlabeled EHR data have…

Health foundation models (FMs) learn useful representations from wearable sensors, but interpreting what they encode and transferring that knowledge across modalities after training remains difficult. We present a post-training framework…

Machine Learning · Computer Science 2026-05-11 Gajendra Katuwal , Advait Koparkar , Salar Abbaspourazad , Anshuman Mishra , Sarvesh Kirthivasan