English
Related papers

Related papers: EmoGator: A New Open Source Vocal Burst Dataset wi…

200 papers

In this manuscript, the topic of multi-corpus Speech Emotion Recognition (SER) is approached from a deep transfer learning perspective. A large corpus of emotional speech data, EmoSet, is assembled from a number of existing SER corpora. In…

Sound · Computer Science 2021-03-16 Maurice Gerczuk , Shahin Amiriparian , Sandra Ottl , Björn Schuller

The availability of large, high-quality emotional speech databases is essential for advancing speech emotion recognition (SER) in real-world scenarios. However, many existing databases face limitations in size, emotional balance, and…

The studies of predicting affective states from human voices have relied heavily on speech. This study, indeed, explores the recognition of humans' affective state from their vocal burst, a short non-verbal vocalization. Borrowing the idea…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Bagus Tris Atmaja , Akira Sasou

In the field of audio and speech analysis, the ability to identify emotions from acoustic signals is essential. Human-computer interaction (HCI) and behavioural analysis are only a few of the many areas where the capacity to distinguish…

Human-Computer Interaction · Computer Science 2023-12-22 Md Gulzar Hussain , Mahmuda Rahman , Babe Sultana , Ye Shiren

In recent years, emotion recognition plays a critical role in applications such as human-computer interaction, mental health monitoring, and sentiment analysis. While datasets for emotion analysis in languages such as English have…

Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states…

Computation and Language · Computer Science 2017-05-09 Jonathan Chang , Stefan Scherer

Visual Emotion Analysis (VEA) aims to bridge the affective gap between visual content and human emotional responses. Despite its promise, progress in this field remains limited by the lack of open-source and interpretable datasets. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yijie Guo , Dexiang Hong , Weidong Chen , Zihan She , Cheng Ye , Xiaojun Chang , Zhendong Mao

Most datasets for sentiment analysis lack context in which an opinion was expressed, often crucial for emotion understanding, and are mainly limited by a few emotion categories. Foundation large language models (LLMs) like GPT-4 suffer from…

Computation and Language · Computer Science 2025-04-24 Alexander Shvets

Current computational-emotion research has focused on applying acoustic properties to analyze how emotions are perceived mathematically or used in natural language processing machine learning models. While recent interest has focused on…

Sound · Computer Science 2021-07-06 Daniel Szelogowski

In this paper, we provide a large audio-visual speaker recognition dataset, VoxBlink2, which includes approximately 10M utterances with videos from 110K+ speakers in the wild. This dataset represents a significant expansion over the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-17 Yuke Lin , Ming Cheng , Fulin Zhang , Yingying Gao , Shilei Zhang , Ming Li

Spontaneous datasets for Speech Emotion Recognition (SER) are scarce and frequently derived from laboratory environments or staged scenarios, such as TV shows, limiting their application in real-world contexts. We developed and publicly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-05 Lucía Gómez-Zaragozá , Rocío del Amor , María José Castro-Bleda , Valery Naranjo , Mariano Alcañiz Raya , Javier Marín-Morales

Emotion detection from text seeks to identify an individual's emotional or mental state - positive, negative, or neutral - based on linguistic cues. While significant progress has been made for English and other high-resource languages,…

Computation and Language · Computer Science 2025-11-11 Abdullah Al Maruf , Aditi Golder , Zakaria Masud Jiyad , Abdullah Al Numan , Tarannum Shaila Zaman

Emotion recognition in conversations is a challenging task that has recently gained popularity due to its potential applications. Until now, however, a large-scale multimodal multi-party emotional conversational database containing more…

Computation and Language · Computer Science 2019-06-05 Soujanya Poria , Devamanyu Hazarika , Navonil Majumder , Gautam Naik , Erik Cambria , Rada Mihalcea

Current expressive speech synthesis models are constrained by the limited availability of open-source datasets containing diverse nonverbal vocalizations (NVs). In this work, we introduce NonverbalTTS (NVTTS), a 17-hour open-access dataset…

Machine Learning · Computer Science 2025-07-18 Maksim Borisov , Egor Spirin , Daria Diatlova

We release the EARS (Expressive Anechoic Recordings of Speech) dataset, a high-quality speech dataset comprising 107 speakers from diverse backgrounds, totaling in 100 hours of clean, anechoic speech data. The dataset covers a large range…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Julius Richter , Yi-Chiao Wu , Steven Krenn , Simon Welker , Bunlong Lay , Shinji Watanabe , Alexander Richard , Timo Gerkmann

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

This is the Proceedings of the ACII Affective Vocal Bursts Workshop and Competition (A-VB). A-VB was a workshop-based challenge that introduces the problem of understanding emotional expression in vocal bursts -- a wide range of non-verbal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Alice Baird , Panagiotis Tzirakis , Jeffrey A. Brooks , Christopher B. Gregory , Björn Schuller , Anton Batliner , Dacher Keltner , Alan Cowen

In this paper, we first provide a review of the state-of-the-art emotional voice conversion research, and the existing emotional speech databases. We then motivate the development of a novel emotional speech database (ESD) that addresses…

Computation and Language · Computer Science 2022-01-11 Kun Zhou , Berrak Sisman , Rui Liu , Haizhou Li

Implementing fine-grained emotion control is crucial for emotion generation tasks because it enhances the expressive capability of the generative model, allowing it to accurately and comprehensively capture and express various nuanced…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Guanwen Feng , Haoran Cheng , Yunan Li , Zhiyuan Ma , Chaoneng Li , Zhihao Qian , Qiguang Miao , Chi-Man Pun

Using mel-spectrograms over conventional MFCCs features, we assess the abilities of convolutional neural networks to accurately recognize and classify emotions from speech data. We introduce FSER, a speech emotion recognition model trained…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Bonaventure F. P. Dossou , Yeno K. S. Gbenou