English
Related papers

Related papers: Emotion Profile Refinery for Speech Emotion Classi…

200 papers

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang

The versatility of Large Language Models (LLMs) in natural language understanding has made them increasingly popular in mental health research. While many studies explore LLMs' capabilities in emotion recognition, a critical gap remains in…

Computation and Language · Computer Science 2025-09-12 Bangzhao Shu , Isha Joshi , Melissa Karnaze , Anh C. Pham , Ishita Kakkar , Sindhu Kothe , Arpine Hovasapian , Mai ElSherief

Contemporary knowledge-based systems increasingly rely on multilingual emotion identification to support intelligent decision-making, yet they face major challenges due to emotional ambiguity and incomplete supervision. Emotion recognition…

Emotion Classification based on text is a task with many applications which has received growing interest in recent years. This paper presents a preliminary study with the goal to help researchers and practitioners gain insight into…

Computation and Language · Computer Science 2023-03-01 Anna Koufakou , Jairo Garciga , Adam Paul , Joseph Morelli , Christopher Frank

In expressive speech synthesis, there are high requirements for emotion interpretation. However, it is time-consuming to acquire emotional audio corpus for arbitrary speakers due to their deduction ability. In response to this problem, this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Pengfei Wu , Junjie Pan , Chenchang Xu , Junhui Zhang , Lin Wu , Xiang Yin , Zejun Ma

The ability to modulate vocal sounds and generate speech is one of the features which set humans apart from other living beings. The human voice can be characterized by several attributes such as pitch, timbre, loudness, and vocal tone. It…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 Poorna Banerjee Dasgupta

Voice interfaces integral to the human-computer interaction systems can benefit from speech emotion recognition (SER) to customize responses based on user emotions. Since humans convey emotions through multi-modal audio-visual cues,…

Machine Learning · Computer Science 2025-07-02 Varsha Pendyala , Pedro Morgado , William Sethares

Efficient discovery of a speaker's emotional states in a multi-party conversation is significant to design human-like conversational agents. During a conversation, the cognitive state of a speaker often alters due to certain past…

Computation and Language · Computer Science 2022-01-03 Shivani Kumar , Anubhav Shrimal , Md Shad Akhtar , Tanmoy Chakraborty

Fully supervised learning has recently achieved promising performance in various electroencephalography (EEG) learning tasks by training on large datasets with ground truth labels. However, labeling EEG data for affective experiments is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Guangyi Zhang , Ali Etemad

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

An advanced emotion classification model was developed using a CNN-Transformer architecture for emotion recognition from EEG brain wave signals, effectively distinguishing among three emotional states, positive, neutral and negative. The…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Roman Dolgopolyi , Antonis Chatzipanagiotou

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger

Traditional speech emotion recognition (SER) evaluations have been performed merely on a speaker-independent condition; some of them even did not evaluate their result on this condition. This paper highlights the importance of splitting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Bagus Tris Atmaja , Akira Sasou

Measuring empathy in conversation can be challenging, as empathy is a complex and multifaceted psychological construct that involves both cognitive and emotional components. Human evaluations can be subjective, leading to inconsistent…

Artificial Intelligence · Computer Science 2023-01-31 Bushra Amjad , Muhammad Zeeshan , Mirza Omer Beg

Understanding the nuances of speech emotion dataset curation and labeling is essential for assessing speech emotion recognition (SER) model potential in real-world applications. Most training and evaluation datasets contain acted or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-17 Amrit Romana , Jaya Narain , Tien Dung Tran , Andrea Davis , Jason Fong , Ramya Rasipuram , Vikramjit Mitra

The performance of Large Language Models (LLMs) is highly sensitive to the prompts they are given. Drawing inspiration from the field of prompt optimization, this study investigates the potential for enhancing Automated Essay Scoring (AES)…

Computation and Language · Computer Science 2025-10-13 Keno Harada , Lui Yoshida , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

One persistent challenge in Speech Emotion Recognition (SER) is the ubiquitous environmental noise, which frequently results in deteriorating SER performance in practice. In this paper, we introduce a Two-level Refinement Network, dubbed…

Sound · Computer Science 2024-09-04 Chengxin Chen , Pengyuan Zhang

Electroencephalography (EEG)-based emotion recognition plays a critical role in affective computing and emerging decision-support systems, yet remains challenging due to high-dimensional, noisy, and subject-dependent signals. This study…

Machine Learning · Computer Science 2026-02-09 S M Rakib UI Karim , Wenyi Lu , Diponkor Bala , Rownak Ara Rasul , Sean Goggins

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

There is an increasing consensus among re- searchers that making a computer emotionally intelligent with the ability to decode human affective states would allow a more meaningful and natural way of human-computer interactions (HCIs). One…

Human-Computer Interaction · Computer Science 2016-06-02 Maria S. Perez-Rosero , Behnaz Rezaei , Murat Akcakaya , Sarah Ostadabbas