English

A Baseline Multimodal Approach to Emotion Recognition in Conversations

Computation and Language 2026-02-03 v1 Artificial Intelligence Computers and Society Sound Audio and Speech Processing

Abstract

We present a lightweight multimodal baseline for emotion recognition in conversations using the SemEval-2024 Task 3 dataset built from the sitcom Friends. The goal of this report is not to propose a novel state-of-the-art method, but to document an accessible reference implementation that combines (i) a transformer-based text classifier and (ii) a self-supervised speech representation model, with a simple late-fusion ensemble. We report the baseline setup and empirical results obtained under a limited training protocol, highlighting when multimodal fusion improves over unimodal models. This preprint is provided for transparency and to support future, more rigorous comparisons.

Keywords

Cite

@article{arxiv.2602.00914,
  title  = {A Baseline Multimodal Approach to Emotion Recognition in Conversations},
  author = {Víctor Yeste and Rodrigo Rivas-Arévalo},
  journal= {arXiv preprint arXiv:2602.00914},
  year   = {2026}
}

Comments

10 pages

R2 v1 2026-07-01T09:29:43.902Z