English
Related papers

Related papers: Foundation models for electronic health records: r…

200 papers

The advent of the Internet era has led to an explosive growth in the Electronic Health Records (EHR) in the past decades. The EHR data can be regarded as a collection of clinical events, including laboratory results, medication records,…

Machine Learning · Computer Science 2019-11-14 Zichang Wang , Haoran Li , Luchen Liu , Haoxian Wu , Ming Zhang

Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used…

Machine Learning · Computer Science 2019-09-23 Wei-Hung Weng , Peter Szolovits

Electronic Health Records (EHR) are high-dimensional data with implicit connections among thousands of medical concepts. These connections, for instance, the co-occurrence of diseases and lab-disease correlations can be informative when…

Machine Learning · Computer Science 2021-03-29 Weicheng Zhu , Narges Razavian

With the widespread of machine learning models for healthcare applications, there is increased interest in building applications for personalized medicine. Despite the plethora of proposed research for personalized medicine, very few focus…

Machine Learning · Computer Science 2024-02-27 Ghadeer O. Ghosheh , Jin Li , Tingting Zhu

Foundation models (FMs) have demonstrated strong performance across diverse pathology tasks. While there are similarities in the pre-training objectives of FMs, there is still limited understanding of their complementarity, redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Brennan Flannery , Thomas DeSilvio , Jane Nguyen , Satish E. Viswanath

While the general machine learning (ML) community has benefited from public datasets, tasks, and models, the progress of ML in healthcare has been hampered by a lack of such shared assets. The success of foundation models creates new…

Machine Learning · Computer Science 2023-12-12 Michael Wornow , Rahul Thapa , Ethan Steinberg , Jason A. Fries , Nigam H. Shah

Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simple linear probe. We…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Basar Demir , Soumitri Chattopadhyay , Thomas Hastings Greer , Boqi Chen , Marc Niethammer

We propose TAMER, a Test-time Adaptive MoE-driven framework for Electronic Health Record (EHR) Representation learning. TAMER introduces a framework where a Mixture-of-Experts (MoE) architecture is co-designed with Test-Time Adaptation…

Machine Learning · Computer Science 2025-03-19 Yinghao Zhu , Xiaochen Zheng , Ahmed Allam , Michael Krauthammer

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

Large Transformers pretrained over clinical notes from Electronic Health Records (EHR) have afforded substantial gains in performance on predictive clinical tasks. The cost of training such models (and the necessity of data access to do so)…

Computation and Language · Computer Science 2021-04-26 Eric Lehman , Sarthak Jain , Karl Pichotta , Yoav Goldberg , Byron C. Wallace

This paper investigates the critical problem of representation similarity evolution during cross-domain transfer learning, with particular focus on understanding why pre-trained models maintain effectiveness when adapted to medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Wenqiang Zu , Shenghao Xie , Hao Chen , Lei Ma

Healthcare systems generate diverse multimodal data, including Electronic Health Records (EHR), clinical notes, and medical images. Effectively leveraging this data for clinical prediction is challenging, particularly as real-world samples…

Machine Learning · Computer Science 2025-09-01 Xiaoyang Wang , Christopher C. Yang

Effective modeling of electronic health records (EHR) is rapidly becoming an important topic in both academia and industry. A recent study showed that using the graphical structure underlying EHR data (e.g. relationship between diagnoses…

Machine Learning · Computer Science 2020-01-22 Edward Choi , Zhen Xu , Yujia Li , Michael W. Dusenberry , Gerardo Flores , Yuan Xue , Andrew M. Dai

Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for brain-computer interfaces (BCIs), aiming to learn transferable neural representations from large-scale heterogeneous recordings. Despite rapid…

Machine Learning · Computer Science 2026-02-06 Dingkun Liu , Yuheng Chen , Zhu Chen , Zhenyao Cui , Yaozhi Wen , Jiayu An , Jingwei Luo , Dongrui Wu

Pathology foundation models (PFMs) have rapidly advanced and are becoming a common backbone for downstream clinical tasks, offering strong transferability across tissues and institutions. However, for dense prediction (e.g., segmentation),…

Image and Video Processing · Electrical Eng. & Systems 2026-02-05 Weiming Chen , Xitong Ling , Xidong Wang , Zhenyang Cai , Yijia Guo , Mingxi Fu , Ziyi Zeng , Minxi Ouyang , Jiawen Li , Yizhi Wang , Tian Guan , Benyou Wang , Yonghong He

Recent advances in transformer architectures have revolutionised natural language processing, but their application to healthcare domains presents unique challenges. Patient timelines are characterised by irregular sampling, variable…

Computation and Language · Computer Science 2025-05-26 Linglong Qian , Zina Ibrahim

The widespread adoption of electronic health records (EHRs) enables the acquisition of heterogeneous clinical data, spanning lab tests, vital signs, medications, and procedures, which offer transformative potential for artificial…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Mingcheng Zhu , Yu Liu , Zhiyao Luo , Tingting Zhu

Over the past decades, computer-aided diagnosis tools for breast cancer have been developed to enhance screening procedures, yet their clinical adoption remains challenged by data variability and inherent biases. Although foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Elodie Germani , Ilayda Selin Türk , Fatima Zeineddine , Charbel Mourad , Shadi Albarqouni

Electronic Health Records (EHR) contain rich longitudinal patient information and are widely used in predictive modeling applications. However, effectively leveraging historical data remains challenging due to long trajectories,…

Information Retrieval · Computer Science 2026-05-13 Saeed Shurrab , Mariam Al-Omari , Dana El Samad , Farah E. Shamout