English

EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation

Multimedia 2026-07-19 v1 Computation and Language Human-Computer Interaction Signal Processing

Abstract

Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.

Keywords

Cite

@article{arxiv.2607.17366,
  title  = {EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation},
  author = {Zilong Huang and Kong Aik Lee and Chong-Xin Gan and Zezhong Jin and Ruichen Zuo and Man-Wai Mak},
  journal= {arXiv preprint arXiv:2607.17366},
  year   = {2026}
}

Comments

Accept by Interspeech 2026