English
Related papers

Related papers: Dynamic Fusion-Aware Graph Convolutional Neural Ne…

200 papers

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Multimodal emotion recognition in conversation (MERC) refers to identifying and classifying human emotional states by combining data from multiple different modalities (e.g., audio, images, text, video, etc.). Most existing multimodal…

Computation and Language · Computer Science 2025-08-13 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

Computation and Language · Computer Science 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

Computation and Language · Computer Science 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

Automatic emotion recognition (AER) based on enriched multimodal inputs, including text, speech, and visual clues, is crucial in the development of emotionally intelligent machines. Although complex modality relationships have been proven…

Multimedia · Computer Science 2021-09-16 Shuyun Tang , Zhaojie Luo , Guoshun Nan , Yuichiro Yoshikawa , Ishiguro Hiroshi

Multimodal Emotion Recognition in Conversations (MERC) aims to predict speakers' emotional states in multi-turn dialogues through text, audio, and visual cues. In real-world settings, conversation scenarios differ significantly in speakers,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Yuntao Shou , Jun Zhou , Tao Meng , Wei Ai , Keqin Li

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Multimodal emotion recognition in conversation (MERC) has garnered substantial research attention recently. Existing MERC methods face several challenges: (1) they fail to fully harness direct inter-modal cues, possibly leading to…

Computation and Language · Computer Science 2025-07-01 Jiang Li , Xiaoping Wang , Zhigang Zeng

Multimodal dialogue emotion recognition captures emotional cues by fusing text, visual, and audio modalities. However, existing approaches still suffer from notable limitations in modeling emotional dependencies and learning multimodal…

Multimedia · Computer Science 2026-03-12 Yunsheng Wang , Yuntao Shou , Yilong Tan , Wei Ai , Tao Meng , Keqin Li

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan

The task of multi-modal emotion recognition in conversation (MERC) aims to analyze the genuine emotional state of each utterance based on the multi-modal information in the conversation, which is crucial for conversation understanding.…

Machine Learning · Computer Science 2024-09-04 Yuntao Shou , Wei Ai , Jiayi Du , Tao Meng , Haiyan Liu , Nan Yin

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

Computation and Language · Computer Science 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

Multimedia · Computer Science 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Multimodal emotion recognition in conversations (MERC) aims to infer the speaker's emotional state by analyzing utterance information from multiple sources (i.e., video, audio, and text). Compared with unimodality, a more robust utterance…

Sound · Computer Science 2025-06-17 Yuntao Shou , Jun Yao , Tao Meng , Wei Ai , Cen Chen , Keqin Li

Multimodal Emotion Recognition in Conversations (MERC) aims to classify utterance emotions using textual, auditory, and visual modal features. Most existing MERC methods assume each utterance has complete modalities, overlooking the common…

Computation and Language · Computer Science 2024-12-02 Fangze Fu , Wei Ai , Fan Yang , Yuntao Shou , Tao Meng , Keqin Li

Nowadays, with the explosive growth of multimodal reviews on social media platforms, multimodal sentiment analysis has recently gained popularity because of its high relevance to these social media posts. Although most previous studies…

Computation and Language · Computer Science 2022-01-26 Luwei Xiao , Xingjiao Wu , Wen Wu , Jing Yang , Liang He

Multimodal emotion recognition in conversation (MERC) seeks to identify the speakers' emotions expressed in each utterance, offering significant potential across diverse fields. The challenge of MERC lies in balancing speaker modeling and…

Multimedia · Computer Science 2025-07-25 Zijian Yi , Ziming Zhao , Zhishu Shen , Tiehua Zhang

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph…

Computation and Language · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Emotion recognition in conversation (ERC) has received much attention, lately, from researchers due to its potential widespread applications in diverse areas, such as health-care, education, and human resources. In this paper, we present…

Computation and Language · Computer Science 2019-09-02 Deepanway Ghosal , Navonil Majumder , Soujanya Poria , Niyati Chhaya , Alexander Gelbukh
‹ Prev 1 2 3 10 Next ›