English
Related papers

Related papers: EDA: Enriching Emotional Dialogue Acts using an En…

200 papers

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Multimodal Emotion Recognition in Conversations (ERC) is a typical multimodal learning task in exploiting various data modalities concurrently. Prior studies on effective multimodal ERC encounter challenges in addressing modality imbalances…

Multimedia · Computer Science 2024-08-26 Cam-Van Thi Nguyen , The-Son Le , Anh-Tuan Mai , Duc-Trong Le

Multimodal emotion recognition (MER), leveraging speech and text, has emerged as a pivotal domain within human-computer interaction, demanding sophisticated methods for effective multimodal integration. The challenge of aligning features…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Xuechen Wang , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiaming Zhou , Yong Qin

The most prominent tasks in emotion analysis are to assign emotions to texts and to understand how emotions manifest in language. An observation for NLP is that emotions can be communicated implicitly by referring to events, appealing to an…

Computation and Language · Computer Science 2022-10-10 Enrica Troiano , Laura Oberländer , Roman Klinger

Emotion plays a crucial role in human conversation. This paper underscores the significance of considering emotion in speech translation. We present the MELD-ST dataset for the emotion-aware speech translation task, comprising…

Computation and Language · Computer Science 2024-05-24 Sirou Chen , Sakiko Yahata , Shuichiro Shimizu , Zhengdong Yang , Yihang Li , Chenhui Chu , Sadao Kurohashi

Sentiment analysis and emotion detection are important research topics in natural language processing (NLP) and benefit many downstream tasks. With the widespread application of LLMs, researchers have started exploring the application of…

Computation and Language · Computer Science 2024-08-27 Zhiwei Liu , Kailai Yang , Tianlin Zhang , Qianqian Xie , Sophia Ananiadou

Deep learning models perform best with abundant, high-quality labels, yet such conditions are rarely achievable in EEG-based emotion recognition. Electroencephalogram (EEG) signals are easily corrupted by artifacts and individual…

Machine Learning · Computer Science 2025-11-20 Hyo-Jeong Jang , Hye-Bin Shin , Kang Yin

There is a mismatch between psychological and computational studies on emotions. Psychological research aims at explaining and documenting internal mechanisms of these phenomena, while computational work often simplifies them into labels.…

Computation and Language · Computer Science 2026-02-03 Enrica Troiano , Sofie Labat , Marco Antonio Stranisci , Viviana Patti , Rossana Damiano , Roman Klinger

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

Predicting how events induce emotions in the characters of a story is typically seen as a standard multi-label classification task, which usually treats labels as anonymous classes to predict. They ignore information that may be conveyed by…

Computation and Language · Computer Science 2020-06-30 Radhika Gaonkar , Heeyoung Kwon , Mohaddeseh Bastan , Niranjan Balasubramanian , Nathanael Chambers

Text emotion detection constitutes a crucial foundation for advancing artificial intelligence from basic comprehension to the exploration of emotional reasoning. Most existing emotion detection datasets rely on manual annotations, which are…

Computation and Language · Computer Science 2025-11-25 Jingyi Zhou , Senlin Luo , Haofan Chen

We present MDEAW, a multimodal database consisting of Electrodermal Activity (EDA) and Photoplethysmography (PPG) signals recorded during the exams for the course taught by the teacher at Eurecat Academy, Sabadell, Barcelona in order to…

Human-Computer Interaction · Computer Science 2022-07-15 Arijit Nandi , Fatos Xhafa , Laia Subirats , Santi Fort

Cross-corpus speech emotion recognition (SER) seeks to generalize the ability of inferring speech emotion from a well-labeled corpus to an unlabeled one, which is a rather challenging task due to the significant discrepancy between two…

Sound · Computer Science 2023-08-07 Jiaxin Ye , Yujie Wei , Xin-Cheng Wen , Chenglong Ma , Zhizhong Huang , Kunhong Liu , Hongming Shan

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Metaphors play a pivotal role in expressing emotions, making them crucial for emotional intelligence. The advent of multimodal data and widespread communication has led to a proliferation of multimodal metaphors, amplifying the complexity…

Computation and Language · Computer Science 2025-05-21 Xingyuan Lu , Yuxi Liu , Dongyu Zhang , Zhiyao Wu , Jing Ren , Feng Xia

Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becoming increasingly popular as a new research frontier in natural…

Computation and Language · Computer Science 2019-05-09 Soujanya Poria , Navonil Majumder , Rada Mihalcea , Eduard Hovy

Speech emotion recognition (SER) has advanced significantly for the sake of deep-learning methods, while textual information further enhances its performance. However, few studies have focused on the physiological information during speech…

Sound · Computer Science 2025-11-12 Ziqian Zhang , Min Huang , Zhongzhe Xiao

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization…

Computation and Language · Computer Science 2023-09-20 Shanglin Lei , Xiaoping Wang , Guanting Dong , Jiang Li , Yingjian Liu

The EMPATHIC project aimed to design an emotionally expressive virtual coach capable of engaging healthy seniors to improve well-being and promote independent aging. One of the core aspects of the system is its human sensing capabilities,…

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

Computation and Language · Computer Science 2023-06-06 Amitabha Dey , Shan Suthaharan