Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals captured from listeners to improve the performance of emotion recognition. In this paper, we present a study of fusion of signals of electroencephalogram (EEG), a tool to capture brainwaves at a high-temporal resolution, and musical features at decision level in recognizing the time-varying binary classes of arousal and valence. Our empirical results showed that the fusion could outperform the performance of emotion recognition using only EEG modality that was suffered from inter-subject variability, and this suggested the promise of multimodal fusion in improving the accuracy of music-emotion recognition.
@article{arxiv.1611.10120,
title = {Fusion of EEG and Musical Features in Continuous Music-emotion Recognition},
author = {Nattapong Thammasan and Ken-ichi Fukui and Masayuki Numao},
journal= {arXiv preprint arXiv:1611.10120},
year = {2016}
}
Comments
The short version of this paper is accepted to appear as an abstract in the proceedings of AAAI-17 (student abstract and poster program)