English

TraM : Enhancing User Sleep Prediction with Transformer-based Multivariate Time Series Modeling and Machine Learning Ensembles

Machine Learning 2024-10-16 v1 Artificial Intelligence

Abstract

This paper presents a novel approach that leverages Transformer-based multivariate time series model and Machine Learning Ensembles to predict the quality of human sleep, emotional states, and stress levels. A formula to calculate the labels was developed, and the various models were applied to user data. Time Series Transformer was used for labels where time series characteristics are crucial, while Machine Learning Ensembles were employed for labels requiring comprehensive daily activity statistics. Time Series Transformer excels in capturing the characteristics of time series through pre-training, while Machine Learning Ensembles select machine learning models that meet our categorization criteria. The proposed model, TraM, scored 6.10 out of 10 in experiments, demonstrating superior performance compared to other methodologies. The code and configuration for the TraM framework are available at: https://github.com/jin-jae/ETRI-Paper-Contest.

Keywords

Cite

@article{arxiv.2410.11293,
  title  = {TraM : Enhancing User Sleep Prediction with Transformer-based Multivariate Time Series Modeling and Machine Learning Ensembles},
  author = {Jinjae Kim and Minjeong Ma and Eunjee Choi and Keunhee Cho and Chanwoo Lee},
  journal= {arXiv preprint arXiv:2410.11293},
  year   = {2024}
}
R2 v1 2026-06-28T19:22:05.249Z