English
Related papers

Related papers: Emotional Voice Conversion: Theory, Databases and …

200 papers

Emotional support (ES) systems alleviate users' mental distress by generating strategic supportive dialogues based on diverse user situations. However, ES systems are limited in their ability to generate effective ES dialogues that include…

Computation and Language · Computer Science 2025-03-24 Shi Yin Hong , Uttamasha Oyshi , Quan Mai , Gibson Nkhata , Susan Gauch

This paper presents CAMEO -- a curated collection of multilingual emotional speech datasets designed to facilitate research in emotion recognition and other speech-related tasks. The main objectives were to ensure easy access to the data,…

Computation and Language · Computer Science 2026-01-28 Iwona Christop , Maciej Czajka

Emotional voice conversion aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. The prior studies on emotional voice conversion are mostly carried out under the…

Sound · Computer Science 2020-10-14 Kun Zhou , Berrak Sisman , Mingyang Zhang , Haizhou Li

Emotional voice conversion (VC) aims to convert a neutral voice to an emotional (e.g. happy) one while retaining the linguistic information and speaker identity. We note that the decoupling of emotional features from other speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Zhaojie Luo , Shoufeng Lin , Rui Liu , Jun Baba , Yuichiro Yoshikawa , Ishiguro Hiroshi

This study introduces EM2LDL, a novel multilingual speech corpus designed to advance mixed emotion recognition through label distribution learning. Addressing the limitations of predominantly monolingual and single-label emotion corpora…

Computation and Language · Computer Science 2025-11-26 Xingfeng Li , Xiaohan Shi , Junjie Li , Yongwei Li , Masashi Unoki , Tomoki Toda , Masato Akagi

The number of end-to-end speech recognition models grows every year. These models are often adapted to new domains or languages resulting in a proliferation of expert systems that achieve great results on target data, while generally…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Igor Gitman , Vitaly Lavrukhin , Aleksandr Laptev , Boris Ginsburg

Emotion recognition in conversations is essential for ensuring advanced human-machine interactions. However, creating robust and accurate emotion recognition systems in real life is challenging, mainly due to the scarcity of emotion…

Computation and Language · Computer Science 2023-08-30 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

In this paper, we propose a new methodology for emotional speech recognition using visual deep neural network models. We employ the transfer learning capabilities of the pre-trained computer vision deep models to have a mandate for the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Waleed Ragheb , Mehdi Mirzapour , Ali Delfardi , Hélène Jacquenet , Lawrence Carbon

Natural human-computer interaction and audio-visual human behaviour sensing systems, which would achieve robust performance in-the-wild are more needed than ever as digital devices are increasingly becoming an indispensable part of our…

Enabling digital humans to express rich emotions has significant applications in dialogue systems, gaming, and other interactive scenarios. While recent advances in talking head synthesis have achieved impressive results in lip…

Artificial Intelligence · Computer Science 2025-10-21 Haidong Xu , Meishan Zhang , Hao Ju , Zhedong Zheng , Erik Cambria , Min Zhang , Hao Fei

We release the EARS (Expressive Anechoic Recordings of Speech) dataset, a high-quality speech dataset comprising 107 speakers from diverse backgrounds, totaling in 100 hours of clean, anechoic speech data. The dataset covers a large range…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Julius Richter , Yi-Chiao Wu , Steven Krenn , Simon Welker , Bunlong Lay , Shinji Watanabe , Alexander Richard , Timo Gerkmann

This paper presents a multifunctional speech synthesis system that integrates voice cloning and emotion control speech synthesis within a unified framework. The goal of this work is to address longstanding challenges in achieving highly…

Computation and Language · Computer Science 2025-08-15 Fengping Tian , Chenyang Lyu , Xuanfan Ni , Haoqin Sun , Qingjuan Li , Zhiqiang Qian , Haijun Li , Longyue Wang , Zhao Xu , Weihua Luo , Kaifu Zhang

Emotional voice conversion models adapt the emotion in speech without changing the speaker identity or linguistic content. They are less data hungry than text-to-speech models and allow to generate large amounts of emotional data for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-15 Bastian Schnell , Goeric Huybrechts , Bartek Perz , Thomas Drugman , Jaime Lorenzo-Trueba

While Current TTS systems perform well in synthesizing high-quality speech, producing highly expressive speech remains a challenge. Emphasis, as a critical factor in determining the expressiveness of speech, has attracted more attention…

Sound · Computer Science 2025-05-27 Yi Zhong , Chen Zhang , Xule Liu , Chenxi Sun , Weishan Deng , Haifeng Hu , Zhongqian Sun

We present a novel feasibility study on the automatic recognition of Expressed Emotion (EE), a family environment concept based on caregivers speaking freely about their relative/family member. We describe an automated approach for…

The aim of this work is to define a speech emotion recognition (SER) model able to recognize positive, neutral and negative emotions in natural conversations of Italian elderly people. Several datasets for SER are available in the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Francesca Gasparini , Alessandra Grossi

Speech emotion recognition is the task of recognizing the speaker's emotional state given a recording of their utterance. While most of the current approaches focus on inferring emotion from isolated utterances, we argue that this is not…

Computation and Language · Computer Science 2021-09-14 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Laureano Moro-Velazquez , Najim Dehak

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies…

Sound · Computer Science 2023-05-02 Ibrahim Malik , Siddique Latif , Sanaullah Manzoor , Muhammad Usama , Junaid Qadir , Raja Jurdak

Emotion Support Conversation (ESC) is a crucial application, which aims to reduce human stress, offer emotional guidance, and ultimately enhance human mental and physical well-being. With the advancement of Large Language Models (LLMs),…

Computation and Language · Computer Science 2024-10-29 Haiquan Zhao , Lingyu Li , Shisong Chen , Shuqi Kong , Jiaan Wang , Kexin Huang , Tianle Gu , Yixu Wang , Wang Jian , Dandan Liang , Zhixu Li , Yan Teng , Yanghua Xiao , Yingchun Wang

Speech Emotion Recognition (SER) typically relies on utterance-level solutions. However, emotions conveyed through speech should be considered as discrete speech events with definite temporal boundaries, rather than attributes of the entire…

Computation and Language · Computer Science 2023-10-23 Yingzhi Wang , Mirco Ravanelli , Alya Yacoubi