English

SeqRisk: Transformer-augmented latent variable model for robust survival prediction with longitudinal data

Machine Learning 2026-02-20 v3

Abstract

In healthcare, risk assessment of patient outcomes has been based on survival analysis for a long time, i.e. modeling time-to-event associations. However, conventional approaches rely on data from a single time-point, making them suboptimal for fully leveraging longitudinal patient history and capturing temporal regularities. Focusing on clinical real-world data and acknowledging its challenges, we utilize latent variable models to effectively handle irregular, noisy, and sparsely observed longitudinal data. We propose SeqRisk, a method that combines variational autoencoder (VAE) or longitudinal VAE (LVAE) with a transformer-based sequence aggregation and Cox proportional hazards module for risk prediction. SeqRisk captures long-range interactions, enhances predictive accuracy and generalizability, as well as provides partial explainability for sample population characteristics in attempts to identify high-risk patients. SeqRisk demonstrated robust performance under conditions of increasing sparsity, consistently surpassing existing approaches.

Keywords

Cite

@article{arxiv.2409.12709,
  title  = {SeqRisk: Transformer-augmented latent variable model for robust survival prediction with longitudinal data},
  author = {Mine Öğretir and Miika Koskinen and Juha Sinisalo and Risto Renkonen and Harri Lähdesmäki},
  journal= {arXiv preprint arXiv:2409.12709},
  year   = {2026}
}
R2 v1 2026-06-28T18:50:12.017Z