English
Related papers

Related papers: Revisiting Multimodal Emotion Recognition in Conve…

200 papers

Multimodal Emotion Recognition in Conversations (MERC) aims to classify utterance emotions using textual, auditory, and visual modal features. Most existing MERC methods assume each utterance has complete modalities, overlooking the common…

Computation and Language · Computer Science 2024-12-02 Fangze Fu , Wei Ai , Fan Yang , Yuntao Shou , Tao Meng , Keqin Li

Multimodal emotion recognition in conversation (MERC) has garnered substantial research attention recently. Existing MERC methods face several challenges: (1) they fail to fully harness direct inter-modal cues, possibly leading to…

Computation and Language · Computer Science 2025-07-01 Jiang Li , Xiaoping Wang , Zhigang Zeng

Multimodal emotion recognition in conversations (MERC) aims to identify and understand the emotions expressed by speakers during utterance interaction from multiple modalities (e.g., text, audio, images, etc.). Existing studies have shown…

Artificial Intelligence · Computer Science 2026-03-25 Tao Meng , Weilun Tang , Yuntao Shou , Yilong Tan , Jun Zhou , Wei Ai , Keqin Li

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

Multimedia · Computer Science 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph…

Computation and Language · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Multimodal emotion recognition in conversation (MERC) seeks to identify the speakers' emotions expressed in each utterance, offering significant potential across diverse fields. The challenge of MERC lies in balancing speaker modeling and…

Multimedia · Computer Science 2025-07-25 Zijian Yi , Ziming Zhao , Zhishu Shen , Tiehua Zhang

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

Computation and Language · Computer Science 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy

Multimodal emotion recognition in conversations (MERC) aims to infer the speaker's emotional state by analyzing utterance information from multiple sources (i.e., video, audio, and text). Compared with unimodality, a more robust utterance…

Sound · Computer Science 2025-06-17 Yuntao Shou , Jun Yao , Tao Meng , Wei Ai , Cen Chen , Keqin Li

Multimodal Emotion Recognition in Conversation (MERC) aims to predict speakers' emotions by integrating textual, acoustic, and visual cues. Existing approaches either struggle to capture complex cross-modal interactions or experience…

Multimedia · Computer Science 2026-03-24 Xiaosen Lyu , Jiayu Xiong , Yuren Chen , Wanlong Wang , Xiaoqing Dai , Jing Wang

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

Computation and Language · Computer Science 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

The task of multi-modal emotion recognition in conversation (MERC) aims to analyze the genuine emotional state of each utterance based on the multi-modal information in the conversation, which is crucial for conversation understanding.…

Machine Learning · Computer Science 2024-09-04 Yuntao Shou , Wei Ai , Jiayi Du , Tao Meng , Haiyan Liu , Nan Yin

Multimodal dialogue emotion recognition captures emotional cues by fusing text, visual, and audio modalities. However, existing approaches still suffer from notable limitations in modeling emotional dependencies and learning multimodal…

Multimedia · Computer Science 2026-03-12 Yunsheng Wang , Yuntao Shou , Yilong Tan , Wei Ai , Tao Meng , Keqin Li

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Multimodal emotion recognition in conversation (MERC) refers to identifying and classifying human emotional states by combining data from multiple different modalities (e.g., audio, images, text, video, etc.). Most existing multimodal…

Computation and Language · Computer Science 2025-08-13 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

Computation and Language · Computer Science 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context. Despite recent progress, key challenges remain, including redundant cross-modal…

Sound · Computer Science 2026-04-17 Chengling Guo , Yuntao Shou , Tao Meng , Wei Ai , Yun Tan , Keqin Li

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan
‹ Prev 1 2 3 10 Next ›