English
Related papers

Related papers: M-MELD: A Multilingual Multi-Party Dataset for Emo…

200 papers

Emotion recognition in conversation (ERC) aims to identify the emotion of each utterance in a conversation, playing a vital role in empathetic artificial intelligence. With the growing of large language models (LLMs), instruction tuning has…

Computation and Language · Computer Science 2025-08-19 Hui Ma , Bo Zhang , Jinpeng Hu , Zenglin Shi

Understanding emotions accurately is essential for fields like human-computer interaction. Due to the complexity of emotions and their multi-modal nature (e.g., emotions are influenced by facial expressions and audio), researchers have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Qize Yang , Detao Bai , Yi-Xing Peng , Xihan Wei

In the Emotion Recognition in Conversation task, recent investigations have utilized attention mechanisms exploring relationships among utterances from intra- and inter-speakers for modeling emotional interaction between them. However,…

Computation and Language · Computer Science 2024-09-24 Jieying Xue , Minh Phuong Nguyen , Blake Matheny , Le Minh Nguyen

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Emotion recognition in conversations (ERC), the task of recognizing the emotion of each utterance in a conversation, is crucial for building empathetic machines. Existing studies focus mainly on capturing context- and speaker-sensitive…

Artificial Intelligence · Computer Science 2023-11-01 Hui Ma , Jian Wang , Hongfei Lin , Bo Zhang , Yijia Zhang , Bo Xu

Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. We propose a novel framework that addresses these issues through three key innovations: (1) a speaker…

Sound · Computer Science 2025-11-19 Xiao Li , Kotaro Funakoshi , Manabu Okumura

Emotion and Intent Joint Understanding in Multimodal Conversation (MC-EIU) aims to decode the semantic information manifested in a multimodal conversational history, while inferring the emotions and intents simultaneously for the current…

Computation and Language · Computer Science 2024-07-08 Rui Liu , Haolin Zuo , Zheng Lian , Xiaofen Xing , Björn W. Schuller , Haizhou Li

Emotion recognition in conversation (ERC) is a crucial task in natural language processing and affective computing. This paper proposes MultiDAG+CL, a novel approach for Multimodal Emotion Recognition in Conversation (ERC) that employs…

Machine Learning · Computer Science 2024-03-11 Cam-Van Thi Nguyen , Cao-Bach Nguyen , Quang-Thuy Ha , Duc-Trong Le

Emotion Recognition in Conversations (ERC) has gained increasing attention for developing empathetic machines. Recently, many approaches have been devoted to perceiving conversational context by deep learning models. However, these…

Computation and Language · Computer Science 2021-06-10 Dou Hu , Lingwei Wei , Xiaoyong Huai

The main task of Multimodal Emotion Recognition in Conversations (MERC) is to identify the emotions in modalities, e.g., text, audio, image and video, which is a significant development direction for realizing machine intelligence. However,…

Sound · Computer Science 2023-12-12 Tao Meng , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

Advancements in spoken language processing have driven the development of spoken language models (SLMs), designed to achieve universal audio understanding by jointly learning text and audio representations for a wide range of tasks.…

Computation and Language · Computer Science 2025-10-31 Pedro Corrêa , João Lima , Victor Moreno , Lucas Ueda , Paula Dornhofer Paro Costa

As the use of interactive machines grow, the task of Emotion Recognition in Conversation (ERC) became more important. If the machine-generated sentences reflect emotion, more human-like sympathetic conversations are possible. Since emotion…

Computation and Language · Computer Science 2022-04-22 Joosung Lee , Wooin Lee

Multimodal Emotion Recognition (MER) is a critical research area that seeks to decode human emotions from diverse data modalities. However, existing machine learning methods predominantly rely on predefined emotion taxonomies, which fail to…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haiyang Sun , Licai Sun , Haoyu Chen , Lan Chen , Hao Gu , Zhuofan Wen , Shun Chen , Siyuan Zhang , Hailiang Yao , Bin Liu , Rui Liu , Shan Liang , Ya Li , Jiangyan Yi , Jianhua Tao

The advent of deep learning models has made a considerable contribution to the achievement of Emotion Recognition in Conversation (ERC). However, this task still remains an important challenge due to the plurality and subjectivity of human…

Computation and Language · Computer Science 2024-04-18 Barbara Gendron , Gaël Guibon

Emotion Recognition in Conversations (ERC) aims to predict the emotional state of speakers in conversations, which is essentially a text classification task. Unlike the sentence-level text classification problem, the available supervised…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Michael R. Lyu , Irwin King

It has been a hot research topic to enable machines to understand human emotions in multimodal contexts under dialogue scenarios, which is tasked with multimodal emotion analysis in conversation (MM-ERC). MM-ERC has received consistent…

Computation and Language · Computer Science 2023-08-15 Bobo Li , Hao Fei , Lizi Liao , Yu Zhao , Chong Teng , Tat-Seng Chua , Donghong Ji , Fei Li

Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component in the development of…

Computation and Language · Computer Science 2023-06-06 Patrícia Pereira , Helena Moniz , Isabel Dias , Joao Paulo Carvalho

The field of affective computing has seen significant advancements in exploring the relationship between emotions and emerging technologies. This paper presents a novel and valuable contribution to this field with the introduction of a…

Artificial Intelligence · Computer Science 2025-01-15 Nessrine Farhat , Amine Bohi , Leila Ben Letaifa , Rim Slama

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Multimodal emotion recognition in conversation (MERC) and multimodal emotion-cause pair extraction (MECPE) have recently garnered significant attention. Emotions are the expression of affect or feelings; responses to specific events, or…

Computation and Language · Computer Science 2024-10-10 Guimin Hu , Zhihong Zhu , Daniel Hershcovich , Lijie Hu , Hasti Seifi , Jiayuan Xie