English

TBDM-Net: Bidirectional Dense Networks with Gender Information for Speech Emotion Recognition

Audio and Speech Processing 2024-09-17 v1 Sound

Abstract

This paper presents a novel deep neural network-based architecture tailored for Speech Emotion Recognition (SER). The architecture capitalises on dense interconnections among multiple layers of bidirectional dilated convolutions. A linear kernel dynamically fuses the outputs of these layers to yield the final emotion class prediction. This innovative architecture is denoted as TBDM-Net: Temporally-Aware Bi-directional Dense Multi-Scale Network. We conduct a comprehensive performance evaluation of TBDM-Net, including an ablation study, across six widely-acknowledged SER datasets for unimodal speech emotion recognition. Additionally, we explore the influence of gender-informed emotion prediction by appending either golden or predicted gender labels to the architecture's inputs or predictions. The implementation of TBDM-Net is accessible at: https://github.com/adrianastan/tbdm-net

Keywords

Cite

@article{arxiv.2409.10056,
  title  = {TBDM-Net: Bidirectional Dense Networks with Gender Information for Speech Emotion Recognition},
  author = {Vlad Striletchi and Cosmin Striletchi and Adriana Stan},
  journal= {arXiv preprint arXiv:2409.10056},
  year   = {2024}
}

Comments

In Proceedings of 2024 IEEE International Workshop on Machine Learning for Signal Processing, London, UK