English

Three-Class Emotion Classification for Audiovisual Scenes Based on Ensemble Learning Scheme

Sound 2025-11-25 v1 Human-Computer Interaction

Abstract

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have demonstrated effectiveness, their reliance on high-performance graphical computing limits deployment on resource-constrained devices such as personal computers or home audiovisual systems. To address this limitation, this study proposes a novel audio-only ensemble learning framework capable of classifying movie scenes into three emotional categories: Good, Neutral, and Bad. The model integrates ten support vector machines and six neural networks within a stacking ensemble architecture to enhance classification performance. A tailored data preprocessing pipeline, including feature extraction, outlier handling, and feature engineering, is designed to optimize emotional information from audio inputs. Experiments on a simulated dataset achieve 67% accuracy, while a real-world dataset collected from 15 diverse films yields an impressive 86% accuracy. These results underscore the potential of audio-based, lightweight emotion recognition methods for broader consumer-level applications, offering both computational efficiency and robust classification capabilities.

Keywords

Cite

@article{arxiv.2511.17926,
  title  = {Three-Class Emotion Classification for Audiovisual Scenes Based on Ensemble Learning Scheme},
  author = {Xiangrui Xiong and Zhou Zhou and Guocai Nong and Junlin Deng and Ning Wu},
  journal= {arXiv preprint arXiv:2511.17926},
  year   = {2025}
}
R2 v1 2026-07-01T07:49:59.635Z