EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation
Abstract
Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.
Keywords
Cite
@article{arxiv.2607.17366,
title = {EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation},
author = {Zilong Huang and Kong Aik Lee and Chong-Xin Gan and Zezhong Jin and Ruichen Zuo and Man-Wai Mak},
journal= {arXiv preprint arXiv:2607.17366},
year = {2026}
}
Comments
Accept by Interspeech 2026