English
Related papers

Related papers: x-vectors meet emotions: A study on dependencies b…

200 papers

Emotion recognition is a key attribute for artificial intelligence systems that need to naturally interact with humans. However, the task definition is still an open problem due to the inherent ambiguity of emotions. In this paper, a novel…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Xixin Wu , Philip C. Woodland

This paper outlines a machine learning-enabled speaker-centric Emotion AI approach capable of predicting audience-affective engagement and vocal attractiveness in asynchronous video-based learning, relying solely on speaker-side affective…

Human-Computer Interaction · Computer Science 2026-03-20 Hung-Yue Suen , Kuo-En Hung , Fan-Hsun Tseng

Speech Emotion Recognition (SER) plays a pivotal role in enhancing human-computer interaction by enabling a deeper understanding of emotional states across a wide range of applications, contributing to more empathetic and effective…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Amirali Soltani Tehrani , Niloufar Faridani , Ramin Toosi

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Marc Casals-Salvador , Federico Costa , Rodolfo Zevallos , Javier Hernando

Speech Emotion Recognition (SER) is crucial in human-machine interactions. Mainstream approaches utilize Convolutional Neural Networks or Recurrent Neural Networks to learn local energy feature representations of speech segments from speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Xiaoyu Tang , Yixin Lin , Ting Dang , Yuanfang Zhang , Jintao Cheng

This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener's unique way of interpreting emotion. Conventional SER systems rely on aggregated…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Liang-Yeh Shen , Shi-Xin Fang , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Traditional voice conversion(VC) has been focused on speaker identity conversion for speech with a neutral expression. We note that emotional expression plays an essential role in daily communication, and the emotional style of speech can…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-22 Zongyang Du , Berrak Sisman , Kun Zhou , Haizhou Li

This paper is devoted to improve automatic emotion recognition from speech by incorporating rhythm and temporal features. Research on automatic emotion recognition so far has mostly been based on applying features like MFCCs, pitch and…

Computer Vision and Pattern Recognition · Computer Science 2013-03-08 Mayank Bhargava , Tim Polzehl

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Herein, we have compared the performance of SVM and MLP in emotion recognition using speech and song channels of the RAVDESS dataset. We have undertaken a journey to extract various audio features, identify optimal scaling strategy and…

Sound · Computer Science 2021-05-21 Behzad Javaheri

Key challenges in developing generalized automatic emotion recognition systems include scarcity of labeled data and lack of gold-standard references. Even for the cues that are labeled as the same emotion category, the variability of…

Sound · Computer Science 2021-06-08 Haoqi Li , Yelin Kim , Cheng-Hao Kuo , Shrikanth Narayanan

Speech emotion recognition (SER) has long benefited from the adoption of deep learning methodologies. Deeper models -- with more layers and more trainable parameters -- are generally perceived as being `better' by the SER community. This…

Sound · Computer Science 2025-08-05 Andreas Triantafyllopoulos , Anton Batliner , Björn W. Schuller

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Speech Emotion Recognition (SER) focuses on identifying emotional states from spoken language. The 2024 IEEE SLT-GenSEC Challenge on Post Automatic Speech Recognition (ASR) Emotion Recognition tasks participants to explore the capabilities…

Computation and Language · Computer Science 2024-11-11 Enshi Zhang , Christian Poellabauer

Text data is commonly utilized as a primary input to enhance Speech Emotion Recognition (SER) performance and reliability. However, the reliance on human-transcribed text in most studies impedes the development of practical SER systems,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-25 Yuanchao Li , Peter Bell , Catherine Lai

Spontaneous datasets for Speech Emotion Recognition (SER) are scarce and frequently derived from laboratory environments or staged scenarios, such as TV shows, limiting their application in real-world contexts. We developed and publicly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-05 Lucía Gómez-Zaragozá , Rocío del Amor , María José Castro-Bleda , Valery Naranjo , Mariano Alcañiz Raya , Javier Marín-Morales

Emotional voice conversion aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. The prior studies on emotional voice conversion are mostly carried out under the…

Sound · Computer Science 2020-10-14 Kun Zhou , Berrak Sisman , Mingyang Zhang , Haizhou Li

Accurately detecting emotions in conversation is a necessary yet challenging task due to the complexity of emotions and dynamics in dialogues. The emotional state of a speaker can be influenced by many different factors, such as…

Computation and Language · Computer Science 2023-02-07 Jiachen Luo , Huy Phan , Joshua Reiss