English
Related papers

Related papers: An Improved StarGAN for Emotional Voice Conversion…

200 papers

Humans can effortlessly modify various prosodic attributes, such as the placement of stress and the intensity of sentiment, to convey a specific emotion while maintaining consistent linguistic content. Motivated by this capability, we…

Sound · Computer Science 2023-12-29 Leyuan Qu , Wei Wang , Cornelius Weber , Pengcheng Yue , Taihao Li , Stefan Wermter

The data scarcity problem in emotion recognition from electroencephalography (EEG) leads to difficulty in building an affective model with high accuracy using machine learning algorithms or deep neural networks. Inspired by emerging deep…

Signal Processing · Electrical Eng. & Systems 2020-06-18 Yun Luo , Li-Zhen Zhu , Zi-Yu Wan , Bao-Liang Lu

Realistic emotional voice conversion (EVC) aims to enhance emotional diversity of converted audios, making the synthesized voices more authentic and natural. To this end, we propose Emotional Intensity-aware Network (EINet), dynamically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-23 Tianhua Qi , Shiyan Wang , Cheng Lu , Yan Zhao , Yuan Zong , Wenming Zheng

Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states…

Computation and Language · Computer Science 2017-05-09 Jonathan Chang , Stefan Scherer

Voice conversion (VC) stands as a crucial research area in speech synthesis, enabling the transformation of a speaker's vocal characteristics to resemble another while preserving the linguistic content. This technology has broad…

Sound · Computer Science 2025-04-29 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

Emotional voice conversion (EVC) focuses on converting a speech utterance from a source to a target emotion; it can thus be a key enabling technology for human-computer interaction applications and beyond. However, EVC remains an unsolved…

Nonparallel multi-domain voice conversion methods such as the StarGAN-VCs have been widely applied in many scenarios. However, the training of these models usually poses a challenge due to their complicated adversarial network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Shijing Si , Jianzong Wang , Xulong Zhang , Xiaoyang Qu , Ning Cheng , Jing Xiao

Voice conversion is to generate a new speech with the source content and a target voice style. In this paper, we focus on one general setting, i.e., non-parallel many-to-many voice conversion, which is close to the real-world scenario. As…

Sound · Computer Science 2022-07-28 Jian Ma , Zhedong Zheng , Hao Fei , Feng Zheng , Tat-seng Chua , Yi Yang

Despite the remarkable progress made in synthesizing emotional speech from text, it is still challenging to provide emotion information to existing speech segments. Previous methods mainly rely on parallel data, and few works have studied…

Sound · Computer Science 2020-03-06 Xiaoqi Jia , Jianwei Tai , Hang Zhou , Yakai Li , Weijuan Zhang , Haichao Du , Qingjia Huang

Nowadays vast amounts of speech data are recorded from low-quality recorder devices such as smartphones, tablets, laptops, and medium-quality microphones. The objective of this research was to study the automatic generation of high-quality…

Popular neural network-based speech enhancement systems operate on the magnitude spectrogram and ignore the phase mismatch between the noisy and clean speech signals. Conditional generative adversarial networks (cGANs) show promise in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Deepak Baby

Lack of large, well-annotated emotional speech corpora continues to limit the performance and robustness of speech emotion recognition (SER), particularly as models grow more complex and the demand for multimodal systems increases. While…

Sound · Computer Science 2026-02-13 Chung-Soo Ahn , Rajib Rana , Sunil Sivadas , Carlos Busso , Jagath C. Rajapakse

Adversarial waveform generation has been a popular approach as the backend of singing voice conversion (SVC) to generate high-quality singing audio. However, the instability of GAN also leads to other problems, such as pitch jitters and U/V…

Sound · Computer Science 2022-01-26 Haohan Guo , Zhiping Zhou , Fanbo Meng , Kai Liu

The data scarcity problem in Electroencephalography (EEG) based affective computing results into difficulty in building an effective model with high accuracy and stability using machine learning algorithms especially deep learning models.…

Machine Learning · Computer Science 2021-09-09 Zhi Zhang , Sheng-hua Zhong , Yan Liu

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Speech emotion conversion is the task of converting the expressed emotion of a spoken utterance to a target emotion while preserving the lexical content and speaker identity. While most existing works in speech emotion conversion rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Navin Raj Prabhu , Bunlong Lay , Simon Welker , Nale Lehmann-Willenbrock , Timo Gerkmann

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

Sound · Computer Science 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Emotional voice conversion aims to convert the spectrum and prosody to change the emotional patterns of speech, while preserving the speaker identity and linguistic content. Many studies require parallel speech data between different…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Kun Zhou , Berrak Sisman , Haizhou Li

Speech enhancement aims to obtain speech signals with high intelligibility and quality from noisy speech. Recent work has demonstrated the excellent performance of time-domain deep learning methods, such as Conv-TasNet. However, these…

Sound · Computer Science 2021-09-21 Feiyang Xiao , Jian Guan , Qiuqiang Kong , Wenwu Wang

This paper presents a deep learning-based approach to emotion detection using Conditional Generative Adversarial Networks (cGANs). Unlike traditional unimodal techniques that rely on a single data type, we explore a multimodal framework…

Machine Learning · Computer Science 2025-08-07 Anushka Srivastava