English
Related papers

Related papers: ChronoFormer: Time-Aware Transformer Architectures…

200 papers

Electronic Health Records (EHR) have been heavily used in modern healthcare systems for recording patients' admission information to hospitals. Many data-driven approaches employ temporal features in EHR for predicting specific diseases,…

Machine Learning · Computer Science 2021-12-07 Chang Lu , Chandan K. Reddy , Yue Ning

We introduce a novel framework for temporal causal discovery and inference that addresses two key challenges: complex nonlinear dependencies and spurious correlations. Our approach employs a multi-layer Transformer-based time-series…

Machine Learning · Computer Science 2025-08-25 Jihua Huang , Yi Yao , Ajay Divakaran

Medical tabular data, abundant in Electronic Health Records (EHRs), is a valuable resource for diverse medical tasks such as risk prediction. While deep learning approaches, particularly transformer-based models, have shown remarkable…

Computation and Language · Computer Science 2025-04-11 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

With the rise of medical foundation models and the growing availability of imaging data, scalable pretraining techniques offer a promising way to identify imaging biomarkers predictive of future disease risk. While current self-supervised…

Accurate and interpretable mortality risk prediction in intensive care units (ICUs) remains a critical challenge due to the irregular temporal structure of electronic health records (EHRs), the complexity of longitudinal disease…

Machine Learning · Computer Science 2026-03-10 Zahra Jafari , Azadeh Zamanifar , Amirfarhad Farhadi

Clinical decision support tools built on electronic health records often experience performance drift due to temporal population shifts, particularly when changes in the clinical environment initially affect only a subset of patients,…

Machine Learning · Computer Science 2025-12-16 Mengying Yan , Ziye Tian , Siqi Li , Nan Liu , Benjamin A. Goldstein , Molei Liu , Chuan Hong

Modeling continuous-time dynamics on irregular time series is critical to account for data evolution and correlations that occur continuously. Traditional methods including recurrent neural networks or Transformer models leverage inductive…

Machine Learning · Computer Science 2024-02-19 Yuqi Chen , Kan Ren , Yansen Wang , Yuchen Fang , Weiwei Sun , Dongsheng Li

Due to potential applications in chronic disease management and personalized healthcare, the EHRs data analysis has attracted much attention of both researchers and practitioners. There are three main challenges in modeling longitudinal and…

Machine Learning · Computer Science 2019-12-03 Yi Huang , Xiaoshan Yang , Changsheng Xu

Large-scale pretraining has transformed modeling of language and other data types, but its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present a novel generative pretraining strategy…

The accurate prediction of survival times for patients with severe diseases remains a critical challenge despite recent advances in artificial intelligence. This study introduces "SurvTimeSurvival: Survival Analysis On Patients With…

Machine Learning · Computer Science 2023-11-17 Hung Le , Ong Eng-Jon , Bober Miroslaw

Electroencephalography (EEG) has emerged as a cost-effective and efficient tool to support neurologists in the detection of Alzheimer's Disease (AD). However, most existing approaches rely heavily on manual feature engineering or data…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Yihe Wang , Nadia Mammone , Darina Petrovsky , Alexandros T. Tzallas , Francesco C. Morabito , Xiang Zhang

Forecasting how a patient's condition is likely to evolve, including possible deterioration, recovery, treatment needs, and care transitions, could support more proactive and personalized care, but requires modeling heterogeneous and…

Machine Learning · Computer Science 2026-03-26 Chantal Pellegrini , Ege Özsoy , David Bani-Harouni , Matthias Keicher , Nassir Navab

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

This study proposes a risk prediction method based on a Multi-Scale Temporal Alignment Network (MSTAN) to address the challenges of temporal irregularity, sampling interval differences, and multi-scale dynamic dependencies in Electronic…

Machine Learning · Computer Science 2025-11-27 Wei-Chen Chang , Lu Dai , Ting Xu

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

Machine Learning · Computer Science 2020-12-01 Batuhan Bardak , Mehmet Tan

Electronic Health Records (EHRs) contain extensive patient information that can inform downstream clinical decisions, such as mortality prediction, disease phenotyping, and disease onset prediction. A key challenge in EHR data analysis is…

Applications · Statistics 2026-01-01 Xin Gai , Shiyi Jiang , Anru R. Zhang

Predicting the incidence of complex chronic conditions such as heart failure is challenging. Deep learning models applied to rich electronic health records may improve prediction but remain unexplainable hampering their wider use in medical…

Electronic Health Records (EHR) systematically organize patient health data through standardized medical codes, serving as a comprehensive and invaluable source for predictive modeling. Graph neural networks (GNNs) have demonstrated…

Machine Learning · Computer Science 2025-08-29 Haiyan Wang , Ye Yuan

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan