English
Related papers

Related papers: VISAFF: Speaker-Centered Visual Affective Feature …

200 papers

Emotion Recognition in Conversations (ERC) aims to predict the emotional state of speakers in conversations, which is essentially a text classification task. Unlike the sentence-level text classification problem, the available supervised…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Michael R. Lyu , Irwin King

Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becoming increasingly popular as a new research frontier in natural…

Computation and Language · Computer Science 2019-05-09 Soujanya Poria , Navonil Majumder , Rada Mihalcea , Eduard Hovy

Emotion Recognition in Conversations (ERCs) is a vital area within multimodal interaction research, dedicated to accurately identifying and classifying the emotions expressed by speakers throughout a conversation. Traditional ERC approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Xinran Li , Xiaomao Fan , Qingyang Wu , Xiaojiang Peng , Ye Li

Emotion Recognition in Conversation (ERC) is a crucial task for understanding human emotions and enabling natural human-computer interaction. Although Large Language Models (LLMs) have recently shown great potential in this field, their…

Artificial Intelligence · Computer Science 2026-04-14 Xinran Li , Yu Liu , Jiaqi Qiao , Xiujuan Xu

Emotion Recognition in Conversation is a core component of affective computing, while current resources of sign language emotion datasets primarily focus on isolated sentences and lack conversational context. Models trained exclusively on…

Computation and Language · Computer Science 2026-05-25 Yusong Wang , Keyu Mao , Takao Obi , Minghao Shao , Kotaro Funakoshi

Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made tremendous progress in the last few years for many visual tasks, potentially offering a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Madhav Agarwal , Sotirios A. Tsaftaris , Laura Sevilla-Lara , Steven McDonagh

Visual Emotion Comprehension (VEC) aims to infer sentiment polarities or emotion categories from affective cues embedded in images. In recent years, Multimodal Large Language Models (MLLMs) have established a popular paradigm in VEC,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Daiqing Wu , Dongbao Yang , Can Ma , Yu Zhou

Multimodal Emotion Recognition in Conversations remains a challenging task due to the complex interplay of textual, acoustic and visual signals. While recent models have improved performance via advanced fusion strategies, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Guanyu Hu , Dimitrios Kollias , Xinyu Yang

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

Creating agents that can both appropriately respond to conversations and understand complex human linguistic tendencies and social cues has been a long standing challenge in the NLP community. A recent pillar of research revolves around…

Machine Learning · Computer Science 2022-07-18 Eriq Augustine , Pegah Jandaghi , Alon Albalak , Connor Pryor , Charles Dickens , William Wang , Lise Getoor

Facial expression recognition (FER) is a key research area in computer vision and human-computer interaction. Despite recent advances in deep learning, challenges persist, especially in generalizing to new scenarios. In fact, zero-shot FER…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Modesto Castrillón-Santana , Oliverio J Santana , David Freire-Obregón , Daniel Hernández-Sosa , Javier Lorenzo-Navarro

In the Emotion Recognition in Conversation task, recent investigations have utilized attention mechanisms exploring relationships among utterances from intra- and inter-speakers for modeling emotional interaction between them. However,…

Computation and Language · Computer Science 2024-09-24 Jieying Xue , Minh Phuong Nguyen , Blake Matheny , Le Minh Nguyen

Emotion Recognition in Conversations (ERC) presents unique challenges, requiring models to capture the temporal flow of multi-turn dialogues and to effectively integrate cues from multiple modalities. We propose Mixture of Speech-Text…

Computation and Language · Computer Science 2026-02-27 Soumya Dutta , Smruthi Balaji , Sriram Ganapathy

Emotion recognition in conversations (ERC) focuses on identifying emotion shifts within interactions, representing a significant step toward advancing machine intelligence. However, ERC data remains scarce, and existing datasets face…

Artificial Intelligence · Computer Science 2025-08-08 Burak Can Kaplan , Hugo Cesar De Castro Carneiro , Stefan Wermter

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

Multimedia · Computer Science 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization…

Computation and Language · Computer Science 2023-09-20 Shanglin Lei , Xiaoping Wang , Guanting Dong , Jiang Li , Yingjian Liu

Emotion recognition (ER) from speech signals is a robust approach since it cannot be imitated like facial expression or text based sentiment analysis. Valuable information underlying the emotions are significant for human-computer…

Sound · Computer Science 2023-12-19 David Hason Rudd , Huan Huo , Guandong Xu

Facial expression recognition (FER) in 3D and 4D domains presents a significant challenge in affective computing due to the complexity of spatial and temporal facial dynamics. Its success is crucial for advancing applications in human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Muzammil Behzad

Emotion recognition in conversation (ERC) has attracted much attention in recent years for its necessity in widespread applications. Existing ERC methods mostly model the self and inter-speaker context separately, posing a major issue for…

Computation and Language · Computer Science 2021-12-24 Chen Liang , Chong Yang , Jing Xu , Juyang Huang , Yongliang Wang , Yang Dong

Emotion recognition in conversation (ERC) aims to analyze the speaker's state and identify their emotion in the conversation. Recent works in ERC focus on context modeling but ignore the representation of contextual emotional tendency. In…

Computation and Language · Computer Science 2022-03-28 Zaijing Li , Fengxiao Tang , Ming Zhao , Yusen Zhu