English
Related papers

Related papers: Gen-SER: When the generative model meets speech em…

200 papers

Speech Emotion Recognition (SER) focuses on identifying emotional states from spoken language. The 2024 IEEE SLT-GenSEC Challenge on Post Automatic Speech Recognition (ASR) Emotion Recognition tasks participants to explore the capabilities…

Computation and Language · Computer Science 2024-11-11 Enshi Zhang , Christian Poellabauer

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

Sound · Computer Science 2024-06-18 Nishargo Nigar

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

Computation and Language · Computer Science 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

Emotion recognition is a classic field of research with a typical setup extracting features and feeding them through a classifier for prediction. On the other hand, generative models jointly capture the distributional relationship between…

Machine Learning · Computer Science 2020-11-16 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Automatic emotion recognition in conversation (ERC) is crucial for emotion-aware conversational artificial intelligence. This paper proposes a distribution-based framework that formulates ERC as a sequence-to-sequence problem for emotion…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Philip C. Woodland

Speech Emotion Recognition (SER) is the use of machines to detect the emotional state of humans based on the speech, which is gaining importance in natural human-computer interaction. Speech is a very valuable source of information, as…

Despite advances in deep learning, current state-of-the-art speech emotion recognition (SER) systems still have poor performance due to a lack of speech emotion datasets. This paper proposes augmenting SER systems with synthetic emotional…

Sound · Computer Science 2023-01-11 Abdullah Shahid , Siddique Latif , Junaid Qadir

Innovations in interaction design are increasingly driven by progress in machine learning fields. Automatic speech emotion recognition (SER) is such an example field on the rise, creating well performing models, which typically take as…

Human-Computer Interaction · Computer Science 2024-12-11 Ilhan Aslan

Speech emotion recognition (SER) is to study the formation and change of speaker's emotional state from the speech signal perspective, so as to make the interaction between human and computer more intelligent. SER is a challenging task that…

Sound · Computer Science 2017-08-01 Yafeng Niu , Dongsheng Zou , Yadong Niu , Zhongshi He , Hua Tan

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

Speech contains rich information on the emotions of humans, and Speech Emotion Recognition (SER) has been an important topic in the area of human-computer interaction. The robustness of SER models is crucial, particularly in…

Sound · Computer Science 2024-02-05 Yi Chang , Zhao Ren , Zixing Zhang , Xin Jing , Kun Qian , Xi Shao , Bin Hu , Tanja Schultz , Björn W. Schuller

The emotion recognition in conversation (ERC) task aims to predict the emotion label of an utterance in a conversation. Since the dependencies between speakers are complex and dynamic, which consist of intra- and inter-speaker dependencies,…

Computation and Language · Computer Science 2022-06-08 Yinan Bao , Qianwen Ma , Lingwei Wei , Wei Zhou , Songlin Hu

Using mel-spectrograms over conventional MFCCs features, we assess the abilities of convolutional neural networks to accurately recognize and classify emotions from speech data. We introduce FSER, a speech emotion recognition model trained…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Bonaventure F. P. Dossou , Yeno K. S. Gbenou

Speech is the most natural way of expressing ourselves as humans. Identifying emotion from speech is a nontrivial task due to the ambiguous definition of emotion itself. Speaker Emotion Recognition (SER) is essential for understanding human…

Sound · Computer Science 2024-11-07 Pourya Jafarzadeh , Amir Mohammad Rostami , Padideh Choobdar

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify…

Machine Learning · Computer Science 2024-07-08 Fei Ma , Yucheng Yuan , Yifan Xie , Hongwei Ren , Ivan Liu , Ying He , Fuji Ren , Fei Richard Yu , Shiguang Ni

The expression of emotion is highly individualistic. However, contemporary speech emotion recognition (SER) systems typically rely on population-level models that adopt a `one-size-fits-all' approach for predicting emotion. Moreover,…

Computation and Language · Computer Science 2025-04-11 Andreas Triantafyllopoulos , Björn Schuller

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang

Speech emotion recognition (SER) systems aim to recognize human emotional state during human-computer interaction. Most existing SER systems are trained based on utterance-level labels. However, not all frames in an audio have affective…

Sound · Computer Science 2023-12-29 Qifei Li , Yingming Gao , Cong Wang , Yayue Deng , Jinlong Xue , Yichen Han , Ya Li

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a…

Computation and Language · Computer Science 2017-07-28 Zhe Gan , Yunchen Pu , Ricardo Henao , Chunyuan Li , Xiaodong He , Lawrence Carin

Voice interfaces integral to the human-computer interaction systems can benefit from speech emotion recognition (SER) to customize responses based on user emotions. Since humans convey emotions through multi-modal audio-visual cues,…

Machine Learning · Computer Science 2025-07-02 Varsha Pendyala , Pedro Morgado , William Sethares