English

SleepVLM: Explainable and Rule-Grounded Sleep Staging via a Vision-Language Model

Computer Vision and Pattern Recognition 2026-04-01 v2 Artificial Intelligence Computation and Language

Abstract

While automated sleep staging has achieved expert-level accuracy, its clinical adoption is hindered by a lack of auditable reasoning. We introduce SleepVLM, a rule-grounded vision-language model (VLM) designed to stage sleep from multi-channel polysomnography (PSG) waveform images while generating clinician-readable rationales based on American Academy of Sleep Medicine (AASM) scoring criteria. Utilizing waveform-perceptual pre-training and rule-grounded supervised fine-tuning, SleepVLM achieved Cohen's kappa scores of 0.767 on an held out test set (MASS-SS1) and 0.743 on an external cohort (ZUAMHCS), matching state-of-the-art performance. Expert evaluations further validated the quality of the model's reasoning, with mean scores exceeding 4.0/5.0 for factual accuracy, evidence comprehensiveness, and logical coherence. By coupling competitive performance with transparent, rule-based explanations, SleepVLM may improve the trustworthiness and auditability of automated sleep staging in clinical workflows. To facilitate further research in interpretable sleep medicine, we release MASS-EX, a novel expert-annotated dataset.

Keywords

Cite

@article{arxiv.2603.26738,
  title  = {SleepVLM: Explainable and Rule-Grounded Sleep Staging via a Vision-Language Model},
  author = {Guifeng Deng and Pan Wang and Jiquan Wang and Shuying Rao and Junyi Xie and Wanjun Guo and Tao Li and Haiteng Jiang},
  journal= {arXiv preprint arXiv:2603.26738},
  year   = {2026}
}

Comments

Under review

R2 v1 2026-07-01T11:41:24.590Z