English
Related papers

Related papers: COGMEN: COntextualized GNN based Multimodal Emotio…

200 papers

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

Computation and Language · Computer Science 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

Multimedia · Computer Science 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interacting in ways familiar…

Computation and Language · Computer Science 2023-10-31 Fathima Abdul Rahman , Guang Lu

Emotion recognition is a crucial task for human conversation understanding. It becomes more challenging with the notion of multimodal data, e.g., language, voice, and facial expressions. As a typical solution, the global- and the local…

Computation and Language · Computer Science 2024-01-31 Cam-Van Thi Nguyen , Anh-Tuan Mai , The-Son Le , Hai-Dang Kieu , Duc-Trong Le

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

Computation and Language · Computer Science 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

A graph neural network (GNN) for image understanding based on multiple cues is proposed in this paper. Compared to traditional feature and decision fusion approaches that neglect the fact that features can interact and exchange information,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Xin Guo , Luisa F. Polania , Bin Zhu , Charles Boncelet , Kenneth E. Barner

The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the…

Computation and Language · Computer Science 2022-03-31 Yunlong Liang , Fandong Meng , Ying Zhang , Jinan Xu , Yufeng Chen , Jie Zhou

The task of multi-modal emotion recognition in conversation (MERC) aims to analyze the genuine emotional state of each utterance based on the multi-modal information in the conversation, which is crucial for conversation understanding.…

Machine Learning · Computer Science 2024-09-04 Yuntao Shou , Wei Ai , Jiayi Du , Tao Meng , Haiyan Liu , Nan Yin

Emotion recognition in conversation (ERC) has received much attention, lately, from researchers due to its potential widespread applications in diverse areas, such as health-care, education, and human resources. In this paper, we present…

Computation and Language · Computer Science 2019-09-02 Deepanway Ghosal , Navonil Majumder , Soujanya Poria , Niyati Chhaya , Alexander Gelbukh

Multimodal emotion recognition in conversation (MERC) refers to identifying and classifying human emotional states by combining data from multiple different modalities (e.g., audio, images, text, video, etc.). Most existing multimodal…

Computation and Language · Computer Science 2025-08-13 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Sentiment Analysis and Emotion Detection in conversation is key in several real-world applications, with an increase in modalities available aiding a better understanding of the underlying emotions. Multi-modal Emotion Detection and…

Computation and Language · Computer Science 2020-08-04 Aman Shenoy , Ashish Sardana

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Commonsense knowledge is crucial to many natural language processing tasks. Existing works usually incorporate graph knowledge with conventional graph neural networks (GNNs), resulting in a sequential pipeline that compartmentalizes the…

Computation and Language · Computer Science 2024-09-24 Hongbo Zhang , Chen Tang , Tyler Loakman , Bohao Yang , Stefan Goetze , Chenghua Lin

Multimodal emotion recognition in conversations (MERC) aims to identify and understand the emotions expressed by speakers during utterance interaction from multiple modalities (e.g., text, audio, images, etc.). Existing studies have shown…

Artificial Intelligence · Computer Science 2026-03-25 Tao Meng , Weilun Tang , Yuntao Shou , Yilong Tan , Jun Zhou , Wei Ai , Keqin Li

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

Conversational Emotion Recognition (CER) aims to predict the emotion expressed by an utterance (referred to as an ``event'') during a conversation. Existing graph-based methods mainly focus on event interactions to comprehend the…

Computation and Language · Computer Science 2024-05-08 Xupeng Zha , Huan Zhao , Zixing Zhang
‹ Prev 1 2 3 10 Next ›