English
Related papers

Related papers: EDA: Enriching Emotional Dialogue Acts using an En…

200 papers

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to multi-modal emotion recognition using a combination of recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

The task of emotion recognition in conversations (ERC) benefits from the availability of multiple modalities, as provided, for example, in the video-based Multimodal EmotionLines Dataset (MELD). However, only a few research approaches use…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-16 Hugo Carneiro , Cornelius Weber , Stefan Wermter

Most automatic emotion recognition systems exploit time-continuous annotations of emotion to provide fine-grained descriptions of spontaneous expressions as observed in real-life interactions. As emotion is rather subjective, its annotation…

Sound · Computer Science 2022-09-22 Sina Alisamir , Fabien Ringeval , Francois Portet

Emotional expressions are inherently multimodal -- integrating facial behavior, speech, and gaze -- but their automatic recognition is often limited to a single modality, e.g. speech during a phone call. While previous work proposed…

Machine Learning · Computer Science 2022-05-03 Ahmed Abdou , Ekta Sood , Philipp Müller , Andreas Bulling

Most research on emotion analysis from text focuses on the task of emotion classification or emotion intensity regression. Fewer works address emotions as a phenomenon to be tackled with structured learning, which can be explained by the…

Computation and Language · Computer Science 2020-03-04 Laura Bostan , Evgeny Kim , Roman Klinger

This study introduces EM2LDL, a novel multilingual speech corpus designed to advance mixed emotion recognition through label distribution learning. Addressing the limitations of predominantly monolingual and single-label emotion corpora…

Computation and Language · Computer Science 2025-11-26 Xingfeng Li , Xiaohan Shi , Junjie Li , Yongwei Li , Masashi Unoki , Tomoki Toda , Masato Akagi

Despite strong recent progress in Emotion Recognition in Conversation (ERC), two gaps remain: we lack clear understanding of which modeling choices materially affect performance, and we have limited linguistic analysis linking recognition…

Computation and Language · Computer Science 2026-02-10 Cheonkam Jeong , Adeline Nyamathi

Understanding the reason for emotional support response is crucial for establishing connections between users and emotional support dialogue systems. Previous works mostly focus on generating better responses but ignore interpretability,…

Computation and Language · Computer Science 2024-06-18 Tenggan Zhang , Xinjie Zhang , Jinming Zhao , Li Zhou , Qin Jin

The mainstream paradigm of speech emotion recognition (SER) is identifying the single emotion label of the entire utterance. This line of works neglect the emotion dynamics at fine temporal granularity and mostly fail to leverage linguistic…

Sound · Computer Science 2024-03-29 Siyuan Shen , Yu Gao , Feng Liu , Hanyang Wang , Aimin Zhou

Emotion annotation is inherently subjective and cognitively demanding, producing signals that reflect diverse perceptions across annotators rather than a single ground truth. In continuous affect prediction, this variability is typically…

Machine Learning · Computer Science 2026-04-09 Kosmas Pinitas , Ilias Maglogiannis

Acoustic emotion recognition aims to categorize the affective state of the speaker and is still a difficult task for machine learning models. The difficulties come from the scarcity of training data, general subjectivity in emotion…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Sven Magg , Stefan Wermter

We describe EmoBank, a corpus of 10k English sentences balancing multiple genres, which we annotated with dimensional emotion metadata in the Valence-Arousal-Dominance (VAD) representation format. EmoBank excels with a bi-perspectival and…

Computation and Language · Computer Science 2022-05-05 Sven Buechel , Udo Hahn

Emotion is an inherently subjective psychophysiological human-state and to produce an agreed-upon representation (gold standard) for continuous emotion requires a time-consuming and costly training procedure of multiple human annotators.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Alice Baird , Lukas Stappen , Lukas Christ , Lea Schumann , Eva-Maria Meßner , Björn W. Schuller

Research in emotion analysis is scattered across different label formats (e.g., polarity types, basic emotion categories, and affective dimensions), linguistic levels (word vs. sentence vs. discourse), and, of course, (few well-resourced…

Computation and Language · Computer Science 2021-11-09 Sven Buechel , Luise Modersohn , Udo Hahn

Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion…

Human-Computer Interaction · Computer Science 2020-09-15 Cheul Young Park , Narae Cha , Soowon Kang , Auk Kim , Ahsan Habib Khandoker , Leontios Hadjileontiadis , Alice Oh , Yong Jeong , Uichin Lee

Unlike spoken languages where the use of prosodic features to convey emotion is well studied, indicators of emotion in sign language remain poorly understood, creating communication barriers in critical settings. Sign languages present…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Phoebe Chua , Cathy Mengying Fang , Takehiko Ohkawa , Raja Kushalnagar , Suranga Nanayakkara , Pattie Maes

Dialogue act classification (DAC) is a critical task for spoken language understanding in dialogue systems. Prosodic features such as energy and pitch have been shown to be useful for DAC. Despite their importance, little research has…

Computation and Language · Computer Science 2022-05-12 Kai Wei , Dillon Knox , Martin Radfar , Thanh Tran , Markus Muller , Grant P. Strimel , Nathan Susanj , Athanasios Mouchtaris , Maurizio Omologo

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

This paper describes EmoRAG, a system designed to detect perceived emotions in text for SemEval-2025 Task 11, Subtask A: Multi-label Emotion Detection. We focus on predicting the perceived emotions of the speaker from a given text snippet,…

Computation and Language · Computer Science 2025-06-06 Lev Morozov , Aleksandr Mogilevskii , Alexander Shirnin