English
Related papers

Related papers: Conversation Understanding using Relational Tempor…

200 papers

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Emotion Recognition in Conversation (ERC) is a practical and challenging task. This paper proposes a novel multimodal approach, the Long-Short Distance Graph Neural Network (LSDGNN). Based on the Directed Acyclic Graph (DAG), it constructs…

Machine Learning · Computer Science 2025-11-21 Xinran Li , Xiujuan Xu , Jiaqi Qiao

Conversational Causal Emotion Entailment aims to detect causal utterances for a non-neutral targeted utterance from a conversation. In this work, we build conversations as graphs to overcome implicit contextual modelling of the original…

Computation and Language · Computer Science 2022-05-10 Jiangnan Li , Fandong Meng , Zheng Lin , Rui Liu , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Emotion recognition in conversation (ERC) has attracted much attention in recent years for its necessity in widespread applications. Existing ERC methods mostly model the self and inter-speaker context separately, posing a major issue for…

Computation and Language · Computer Science 2021-12-24 Chen Liang , Chong Yang , Jing Xu , Juyang Huang , Yongliang Wang , Yang Dong

Emotion recognition in conversation (ERC) aims to detect the emotion for each utterance in a given conversation. The newly proposed ERC models have leveraged pre-trained language models (PLMs) with the paradigm of pre-training and…

Computation and Language · Computer Science 2022-07-28 Jingjie Yi , Deqing Yang , Siyu Yuan , Caiyan Cao , Zhiyao Zhang , Yanghua Xiao

The inevitable modality imperfection in real-world scenarios poses significant challenges for Multimodal Sentiment Analysis (MSA). While existing methods tailor reconstruction or joint representation learning strategies to restore missing…

Multimedia · Computer Science 2025-08-05 Hu Zhangfeng , Shi mengxin

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to multi-modal emotion recognition using a combination of recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

Multimedia · Computer Science 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

Multimodal emotion recognition in conversations (MERC) aims to identify and understand the emotions expressed by speakers during utterance interaction from multiple modalities (e.g., text, audio, images, etc.). Existing studies have shown…

Artificial Intelligence · Computer Science 2026-03-25 Tao Meng , Weilun Tang , Yuntao Shou , Yilong Tan , Jun Zhou , Wei Ai , Keqin Li

Emotional support conversation aims at reducing the emotional distress of the help-seeker, which is a new and challenging task. It requires the system to explore the cause of help-seeker's emotional distress and understand their…

Computation and Language · Computer Science 2022-11-09 Wei Peng , Yue Hu , Luxi Xing , Yuqiang Xie , Yajing Sun , Yunpeng Li

Emotion Recognition in Conversation (ERC) involves detecting the underlying emotion behind each utterance within a conversation. Effectively generating representations for utterances remains a significant challenge in this task. Recent…

Computation and Language · Computer Science 2024-04-01 Fangxu Yu , Junjie Guo , Zhen Wu , Xinyu Dai

Understanding emotions during conversation is a fundamental aspect of human communication, driving NLP research for Emotion Recognition in Conversation (ERC). While considerable research has focused on discerning emotions of individual…

Computation and Language · Computer Science 2023-10-23 Shivani Kumar , Ramaneswaran S , Md Shad Akhtar , Tanmoy Chakraborty

Efficient discovery of a speaker's emotional states in a multi-party conversation is significant to design human-like conversational agents. During a conversation, the cognitive state of a speaker often alters due to certain past…

Computation and Language · Computer Science 2022-01-03 Shivani Kumar , Anubhav Shrimal , Md Shad Akhtar , Tanmoy Chakraborty

Understanding learner emotions in online education is critical for improving engagement and personalized instruction. While prior work in emotion recognition has explored multimodal fusion and temporal modeling, existing methods often rely…

Machine Learning · Computer Science 2025-10-13 S M Rafiuddin

Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality, such as vision, audio, and text, or a combination of…

Machine Learning · Computer Science 2022-02-21 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

This paper deals with the utterance-level modalities missing problem with uncertain patterns on emotion recognition in conversation (ERC) task. Present models generally predict the speaker's emotions by its current utterance and context,…

Sound · Computer Science 2022-05-06 Ning Wang