English
Related papers

Related papers: Switchboard-Affect: Emotion Perception Labels from…

200 papers

Telling stories is an integral part of human communication which can evoke emotions and influence the affective states of the audience. Automatically modeling emotional trajectories in stories has thus attracted considerable scholarly…

Computation and Language · Computer Science 2024-06-05 Lukas Christ , Shahin Amiriparian , Manuel Milling , Ilhan Aslan , Björn W. Schuller

Emotional state recognition through speech is being a very interesting research topic nowadays. Using subliminal information of speech, denominated as prosody, it is possible to recognize the emotional state of the person. One of the main…

Computer Vision and Pattern Recognition · Computer Science 2014-03-20 Inma Mohino-Herranz , Roberto Gil-Pita , Sagrario Alonso-Diaz , Manuel Rosa-Zurera

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

Sound · Computer Science 2024-06-18 Nishargo Nigar

Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition.…

Sound · Computer Science 2023-12-29 Vikramjit Mitra , Jingping Nie , Erdrin Azemi

Imbalanced data commonly exists in real world, espacially in sentiment-related corpus, making it difficult to train a classifier to distinguish latent sentiment in text data. We observe that humans often express transitional emotion between…

Computation and Language · Computer Science 2019-03-29 Tao Zhang , Xing Wu , Meng Lin , Jizhong Han , Songlin Hu

Affective computing aims to understand and model human emotions for computational systems. Within this field, speech emotion recognition (SER) focuses on predicting emotions conveyed through speech. While early SER systems relied on limited…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 Luz Martinez-Lucas , Pravin Mote , Abinay Reddy Naini , Mohammed Abdelwahab , Carlos Busso

Emotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity. Prior studies show that it is possible to disentangle emotional prosody using an encoder-decoder network…

Sound · Computer Science 2021-02-12 Kun Zhou , Berrak Sisman , Rui Liu , Haizhou Li

Facial emotion recognition has been typically cast as a single-label classification problem of one out of six prototypical emotions. However, that is an oversimplification that is unsuitable for representing the multifaceted spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Joao Baptista Cardia Neto , Claudio Ferrari , Stefano Berretti

In recent years, Sentiment Analysis (SA) and Emotion Recognition (ER) have been increasingly popular in the Bangla language, which is the seventh most spoken language throughout the entire world. However, the language is structurally…

Speech emotions are crucial in human communication and are extensively used in fields like speech synthesis and natural language understanding. Most prior studies, such as speech emotion recognition, have categorized speech emotions into a…

Multimodal emotion recognition is an important research topic in artificial intelligence. Over the past few decades, researchers have made remarkable progress by increasing the dataset size and building more effective algorithms. However,…

Emotion perception and adaptive expression are fundamental capabilities in human-agent interaction. While recent advances in speech emotion captioning (SEC) have improved fine-grained emotional modeling, existing systems remain limited to…

Computation and Language · Computer Science 2026-04-30 Shuhao Xu , Yifan Hu , Jingjing Wu , Zhihao Du , Zheng Lian , Rui Liu

As different people perceive others' emotional expressions differently, their annotation in terms of arousal and valence are per se subjective. To address this, these emotion annotations are typically collected by multiple annotators and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkmann

Sentiment classification involves quantifying the affective reaction of a human to a document, media item or an event. Although researchers have investigated several methods to reliably infer sentiment from lexical, speech and body language…

Information Retrieval · Computer Science 2018-06-11 Rahul Gupta , Saurabh Sahu , Carol Espy-Wilson , Shrikanth Narayanan

Social aspects of software projects become increasingly important for research and practice. Different approaches analyze the sentiment of a development team, ranging from simply asking the team to so-called sentiment analysis on text-based…

Software Engineering · Computer Science 2022-07-19 Marc Herrmann , Martin Obaidi , Larissa Chazette , Jil Klünder

Speech emotion recognition~(SER) refers to the technique of inferring the emotional state of an individual from speech signals. SERs continue to garner interest due to their wide applicability. Although the domain is mainly founded on…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-29 Sneha Das , Nicklas Leander Lund , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Multi-label sentiment classification plays a vital role in natural language processing by detecting multiple emotions within a single text. However, existing datasets like GoEmotions often suffer from severe class imbalance, which hampers…

Computation and Language · Computer Science 2026-03-31 Zijin Su , Huanzhu Lyu , Yuren Niu , Yiming Liu

Spontaneous datasets for Speech Emotion Recognition (SER) are scarce and frequently derived from laboratory environments or staged scenarios, such as TV shows, limiting their application in real-world contexts. We developed and publicly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-05 Lucía Gómez-Zaragozá , Rocío del Amor , María José Castro-Bleda , Valery Naranjo , Mariano Alcañiz Raya , Javier Marín-Morales

The lack of contextual information in text data can make the annotation process of text-based emotion classification datasets challenging. As a result, such datasets often contain labels that fail to consider all the relevant emotions in…

Computation and Language · Computer Science 2023-11-08 Daniel Yang , Aditya Kommineni , Mohammad Alshehri , Nilamadhab Mohanty , Vedant Modi , Jonathan Gratch , Shrikanth Narayanan

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in…