On the Contribution of Lexical Features to Speech Emotion Recognition
Audio and Speech Processing
2025-09-09 v1 Computation and Language
Sound
Abstract
Although paralinguistic cues are often considered the primary drivers of speech emotion recognition (SER), we investigate the role of lexical content extracted from speech and show that it can achieve competitive and in some cases higher performance compared to acoustic models. On the MELD dataset, our lexical-based approach obtains a weighted F1-score (WF1) of 51.5%, compared to 49.3% for an acoustic-only pipeline with a larger parameter count. Furthermore, we analyze different self-supervised (SSL) speech and text representations, conduct a layer-wise study of transformer-based encoders, and evaluate the effect of audio denoising.
Keywords
Cite
@article{arxiv.2509.05634,
title = {On the Contribution of Lexical Features to Speech Emotion Recognition},
author = {David Combei},
journal= {arXiv preprint arXiv:2509.05634},
year = {2025}
}
Comments
Accepted to 13th Conference on Speech Technology and Human-Computer Dialogue