English

MIS-LSTM: Multichannel Image-Sequence LSTM for Sleep Quality and Stress Prediction

Computer Vision and Pattern Recognition 2025-09-16 v1 Artificial Intelligence

Abstract

This paper presents MIS-LSTM, a hybrid framework that joins CNN encoders with an LSTM sequence model for sleep quality and stress prediction at the day level from multimodal lifelog data. Continuous sensor streams are first partitioned into N-hour blocks and rendered as multi-channel images, while sparse discrete events are encoded with a dedicated 1D-CNN. A Convolutional Block Attention Module fuses the two modalities into refined block embeddings, which an LSTM then aggregates to capture long-range temporal dependencies. To further boost robustness, we introduce UALRE, an uncertainty-aware ensemble that overrides lowconfidence majority votes with high-confidence individual predictions. Experiments on the 2025 ETRI Lifelog Challenge dataset show that Our base MISLSTM achieves Macro-F1 0.615; with the UALRE ensemble, the score improves to 0.647, outperforming strong LSTM, 1D-CNN, and CNN baselines. Ablations confirm (i) the superiority of multi-channel over stacked-vertical imaging, (ii) the benefit of a 4-hour block granularity, and (iii) the efficacy of modality-specific discrete encoding.

Keywords

Cite

@article{arxiv.2509.11232,
  title  = {MIS-LSTM: Multichannel Image-Sequence LSTM for Sleep Quality and Stress Prediction},
  author = {Seongwan Park and Jieun Woo and Siheon Yang},
  journal= {arXiv preprint arXiv:2509.11232},
  year   = {2025}
}

Comments

ICTC 2025