English
Related papers

Related papers: Speaker-Guided Encoder-Decoder Framework for Emoti…

200 papers

Speech is the most natural way of expressing ourselves as humans. Identifying emotion from speech is a nontrivial task due to the ambiguous definition of emotion itself. Speaker Emotion Recognition (SER) is essential for understanding human…

Sound · Computer Science 2024-11-07 Pourya Jafarzadeh , Amir Mohammad Rostami , Padideh Choobdar

Expression of emotions is a crucial part of daily human communication. Emotion recognition in conversations (ERC) is an emerging field of study, where the primary task is to identify the emotion behind each utterance in a conversation.…

Computation and Language · Computer Science 2023-04-03 Sreyan Ghosh , S Ramaneswaran , Utkarsh Tyagi , Harshvardhan Srivastava , Samden Lepcha , S Sakshi , Dinesh Manocha

Empathetic speech dialogue requires not only understanding linguistic content but also perceiving rich paralinguistic information such as prosody, tone, and emotional intensity for affective understandings. Existing speech-to-speech large…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Zhuoyue Gao , Xiaohui Wang , Xiaocui Yang , Wen Zhang , Daling Wang , Shi Feng , Yifei Zhang

Group-level emotion recognition (GER) aims to identify holistic emotions within a scene involving multiple individuals. Current existed methods underestimate the importance of visual scene contextual information in modeling individual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qing Zhu , Wangdong Guo , Qirong Mao , Xiaohua Huang , Xiuyan Shao , Wenming Zheng

For the task of conversation emotion recognition, recent works focus on speaker relationship modeling but ignore the role of utterance's emotional tendency.In this paper, we propose a new expression paradigm of sentence-level emotion…

Computation and Language · Computer Science 2021-12-23 Zaijing Li , Fengxiao Tang , Tieyu Sun , Yusen Zhu , Ming Zhao

Emotion recognition in conversations (ERC) focuses on identifying emotion shifts within interactions, representing a significant step toward advancing machine intelligence. However, ERC data remains scarce, and existing datasets face…

Artificial Intelligence · Computer Science 2025-08-08 Burak Can Kaplan , Hugo Cesar De Castro Carneiro , Stefan Wermter

Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context. Despite recent progress, key challenges remain, including redundant cross-modal…

Sound · Computer Science 2026-04-17 Chengling Guo , Yuntao Shou , Tao Meng , Wei Ai , Yun Tan , Keqin Li

In the Emotion Recognition in Conversation task, recent investigations have utilized attention mechanisms exploring relationships among utterances from intra- and inter-speakers for modeling emotional interaction between them. However,…

Computation and Language · Computer Science 2024-09-24 Jieying Xue , Minh Phuong Nguyen , Blake Matheny , Le Minh Nguyen

Emotion recognition in conversation, which aims to predict the emotion for all utterances, has attracted considerable research attention in recent years. It is a challenging task since the recognition of the emotion in one utterance…

Computation and Language · Computer Science 2023-06-13 Ting Zhang , Zhuang Chen , Ming Zhong , Tieyun Qian

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

Computation and Language · Computer Science 2023-06-06 Amitabha Dey , Shan Suthaharan

Emotion Recognition in Conversation (ERC) aims to detect the emotions of individual utterances within a conversation. Generating efficient and modality-specific representations for each utterance remains a significant challenge. Previous…

Machine Learning · Computer Science 2025-06-24 Jie Li , Shifei Ding , Lili Guo , Xuan Li

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assumed that emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-03 Ismail Rasim Ulgen , Zongyang Du , Carlos Busso , Berrak Sisman

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

In emotion recognition in conversation (ERC), the emotion of the current utterance is predicted by considering the previous context, which can be utilized in many natural language processing tasks. Although multiple emotions can coexist in…

Computation and Language · Computer Science 2022-06-17 Joosung Lee

Emotion recognition in conversations (ERC) is a crucial task for building human-like conversational agents. While substantial efforts have been devoted to ERC for chit-chat dialogues, the task-oriented counterpart is largely left…

Emotion Recognition in Conversation is a core component of affective computing, while current resources of sign language emotion datasets primarily focus on isolated sentences and lack conversational context. Models trained exclusively on…

Computation and Language · Computer Science 2026-05-25 Yusong Wang , Keyu Mao , Takao Obi , Minghao Shao , Kotaro Funakoshi

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Conversational Speech Synthesis (CSS) aims to accurately express an utterance with the appropriate prosody and emotional inflection within a conversational setting. While recognising the significance of CSS task, the prior studies have not…

Computation and Language · Computer Science 2023-12-20 Rui Liu , Yifan Hu , Yi Ren , Xiang Yin , Haizhou Li

Emotion recognition in conversation (ERC) has emerged as a research hotspot in domains such as conversational robots and question-answer systems. How to efficiently and adequately retrieve contextual emotional cues has been one of the key…

Computation and Language · Computer Science 2024-01-26 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng