English
Related papers

Related papers: Multi-modal Anchor Gated Transformer with Knowledg…

200 papers

Electroencephalography (EEG) is a fundamental modality for cognitive state monitoring in brain-computer interfaces (BCIs). However, it is highly susceptible to intrinsic signal errors and human-induced labeling errors, which lead to label…

Machine Learning · Computer Science 2025-12-15 Hyo-Jeong Jang , Hye-Bin Shin , Seong-Whan Lee

Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. We propose a novel framework that addresses these issues through three key innovations: (1) a speaker…

Sound · Computer Science 2025-11-19 Xiao Li , Kotaro Funakoshi , Manabu Okumura

Emotion Recognition in Conversations (ERC) is a key step towards successful human-machine interaction. While the field has seen tremendous advancement in the last few years, new applications and implementation scenarios present novel…

Computation and Language · Computer Science 2024-10-22 Patrícia Pereira , Helena Moniz , Joao Paulo Carvalho

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

Emotion Recognition in Conversation (ERC) is critical for enabling natural human-machine interactions. However, existing methods predominantly employ categorical or dimensional emotion annotations, which often fail to adequately represent…

Computation and Language · Computer Science 2026-03-10 Yoshiki Tanaka , Ryuichi Uehara , Koji Inoue , Michimasa Inaba

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

Computation and Language · Computer Science 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Emotion Recognition in Conversation (ERC) is a more challenging task than conventional text emotion recognition. It can be regarded as a personalized and interactive emotion recognition task, which is supposed to consider not only the…

Computation and Language · Computer Science 2021-01-01 Jiangnan Li , Zheng Lin , Peng Fu , Qingyi Si , Weiping Wang

Multimodal Emotion Recognition in Conversations (MERC) identifies emotional states across text, audio and video, which is essential for intelligent dialogue systems and opinion analysis. Existing methods emphasize heterogeneous modal fusion…

Machine Learning · Computer Science 2025-04-01 Jiagen Li , Rui Yu , Huihao Huang , Huaicheng Yan

Emotion Recognition in Conversation~(ERC) across modalities is of vital importance for a variety of applications, including intelligent healthcare, artificial intelligence for conversation, and opinion mining over chat history. The crux of…

Computation and Language · Computer Science 2023-06-07 Xingwei Liang , You Zou , Ruifeng Xu

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Automated emotion detection in speech is a challenging task due to the complex interdependence between words and the manner in which they are spoken. It is made more difficult by the available datasets; their small size and incompatible…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-16 Amith Ananthram , Kailash Karthik Saravanakumar , Jessica Huynh , Homayoon Beigi

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Multimodal emotion recognition in conversation (MERC) requires representations that effectively integrate signals from multiple modalities. These signals include modality-specific cues, information shared across modalities, and interactions…

Machine Learning · Computer Science 2026-01-22 Anh-Tuan Mai , Cam-Van Thi Nguyen , Duc-Trong Le

The field of emotion recognition of conversation (ERC) has been focusing on separating sentence feature encoding and context modeling, lacking exploration in generative paradigms based on unified designs. In this study, we propose a novel…

Computation and Language · Computer Science 2024-08-30 Shanglin Lei , Guanting Dong , Xiaoping Wang , Keheng Wang , Runqi Qiao , Sirui Wang

Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation. Recently, Graph Neural Networks (GNNs) have demonstrated their strengths in…

Computation and Language · Computer Science 2024-12-24 Cuong Tran Van , Thanh V. T. Tran , Van Nguyen , Truong Son Hy

Multimodal emotion recognition in conversations (mERC) is an active research topic in natural language processing (NLP), which aims to predict human's emotional states in communications of multiple modalities, e,g., natural language and…

Computation and Language · Computer Science 2022-07-19 Jinglin Wang , Fang Ma , Yazhou Zhang , Dawei Song

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph…

Computation and Language · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Multimodal emotion recognition (MER) extracts emotions from multimodal data, including visual, speech, and text inputs, playing a key role in human-computer interaction. Attention-based fusion methods dominate MER research, achieving strong…

Artificial Intelligence · Computer Science 2025-06-03 Jiajun He , Jinyi Mi , Tomoki Toda

Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have focused on modeling these dependencies primarily via…

Computation and Language · Computer Science 2020-05-21 Devamanyu Hazarika , Soujanya Poria , Roger Zimmermann , Rada Mihalcea