English
Related papers

Related papers: StarGAN-VC++: Towards Emotion Preserving Voice Con…

200 papers

Voice conversion (VC) modifies voice characteristics while preserving linguistic content. This paper presents the Stepback network, a novel model for converting speaker identity using non-parallel data. Unlike traditional VC methods that…

Sound · Computer Science 2025-01-28 Qian Yang , Calbert Graham

Emotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity. Prior studies show that it is possible to disentangle emotional prosody using an encoder-decoder network…

Sound · Computer Science 2021-02-12 Kun Zhou , Berrak Sisman , Rui Liu , Haizhou Li

The ability to accurately capture and express emotions is a critical aspect of creating believable characters in video games and other forms of entertainment. Traditionally, this animation has been achieved with artistic effort or…

Graphics · Computer Science 2023-07-19 Jack Saunders , Steven Caulkin , Vinay Namboodiri

Numerous voice conversion (VC) techniques have been proposed for the conversion of voices among different speakers. Although good quality of the converted speech can be observed when VC is applied in a clean environment, the quality…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-20 Yun-Ju Chan , Chiang-Jen Peng , Syu-Siang Wang , Hsin-Min Wang , Yu Tsao , Tai-Shih Chi

This paper focuses on using voice conversion (VC) to improve the speech intelligibility of surgical patients who have had parts of their articulators removed. Due to the difficulty of data collection, VC without parallel data is highly…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-26 Li-Wei Chen , Hung-Yi Lee , Yu Tsao

Identity, accent, style, and emotions are essential components of human speech. Voice conversion (VC) techniques process the speech signals of two input speakers and other modalities of auxiliary information such as prompts and emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-09 Xining Song , Zhihua Wei , Rui Wang , Haixiao Hu , Yanxiang Chen , Meng Han

Emotional voice conversion (EVC) aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. In this paper, we study the disentanglement and recomposition of emotional…

Sound · Computer Science 2020-11-05 Kun Zhou , Berrak Sisman , Haizhou Li

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

Sound · Computer Science 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel

The human voice conveys not just words but also emotional states and individuality. Emotional voice conversion (EVC) modifies emotional expressions while preserving linguistic content and speaker identity, improving applications like…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-29 Hsing-Hang Chou , Yun-Shao Lin , Ching-Chin Sung , Yu Tsao , Chi-Chun Lee

Expressive voice conversion performs identity conversion for emotional speakers by jointly converting speaker identity and emotional style. Due to the hierarchical structure of speech emotion, it is challenging to disentangle the emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Zongyang Du , Berrak Sisman , Kun Zhou , Haizhou Li

Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted…

Sound · Computer Science 2021-04-09 Leonardo Pepino , Pablo Riera , Luciana Ferrer

Voice conversion (VC) is a task to transform a person's voice to different style while conserving linguistic contents. Previous state-of-the-art on VC is based on sequence-to-sequence (seq2seq) model, which could mislead linguistic…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-28 Tae-Ho Kim , Sungjae Cho , Shinkook Choi , Sejik Park , Soo-Young Lee

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire.…

Sound · Computer Science 2020-02-18 Shindong Lee , BongGu Ko , Keonnyeong Lee , In-Chul Yoo , Dongsuk Yook

Disentanglement-based speaker anonymization involves decomposing speech into a semantically meaningful representation, altering the speaker embedding, and resynthesizing a waveform using a neural vocoder. State-of-the-art systems of this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Ünal Ege Gaznepoglu , Nils Peters

Voice conversion (VC) systems are widely used for several applications, from speaker anonymisation to personalised speech synthesis. Supervised approaches learn a mapping between different speakers using parallel data, which is expensive to…

Emotional state of a speaker is found to have significant effect in speech production, which can deviate speech from that arising from neutral state. This makes identifying speakers with different emotions a challenging task as generally…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-09 Biswajit Dev Sarma , Rohan Kumar Das

In this study, we explore the transformer's ability to capture intra-relations among frames by augmenting the receptive field of models. Concretely, we propose a CycleGAN-based model with the transformer and investigate its ability in the…

Sound · Computer Science 2021-12-01 Changzeng Fu , Chaoran Liu , Carlos Toshinori Ishi , Hiroshi Ishiguro

Traditional voice conversion methods rely on parallel recordings of multiple speakers pronouncing the same sentences. For real-world applications however, parallel data is rarely available. We propose MelGAN-VC, a voice conversion method…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-06 Marco Pasini

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Songxiang Liu , Yuewen Cao , Shiyin Kang , Na Hu , Xunying Liu , Dan Su , Dong Yu , Helen Meng

A general disentanglement-based speaker anonymization system typically separates speech into content, speaker, and prosody features using individual encoders. This paper explores how to adapt such a system when a new speech attribute, for…