English
Related papers

Related papers: Beyond Voice Identity Conversion: Manipulating Voi…

200 papers

Voice Conversion (VC) is a technique that aims to transform the non-linguistic information of a source utterance to change the perceived identity of the speaker. While there is a rich literature on VC, most proposed methods are trained and…

Zero-shot voice conversion is becoming an increasingly popular research topic, as it promises the ability to transform speech to sound like any speaker. However, relatively little work has been done on end-to-end methods for this task,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-04 Wonjune Kang , Mark Hasegawa-Johnson , Deb Roy

Audio watermarking embeds auxiliary information into speech while maintaining speaker identity, linguistic content, and perceptual quality. Although recent advances in neural and digital signal processing-based watermarking methods have…

Sound · Computer Science 2026-03-17 Yigitcan Özer , Wanying Ge , Zhe Zhang , Xin Wang , Junichi Yamagishi

Voice conversion aims to convert source speech into a target voice using recordings of the target speaker as a reference. Newer models are producing increasingly realistic output. But what happens when models are fed with non-standard data,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-13 Matthew Baas , Herman Kamper

Privacy-preserving voice conversion aims to remove only the attributes of speech audio that convey identity information, keeping other speech characteristics intact. This paper presents a mechanism for privacy-preserving voice conversion…

Sound · Computer Science 2024-09-24 Jacob J Webber , Oliver Watts , Gustav Eje Henter , Jennifer Williams , Simon King

Voice conversion (VC) is a task that transforms voice from target audio to source without losing linguistic contents, it is challenging especially when source and target speakers are unseen during training (zero-shot VC). Previous…

Sound · Computer Science 2021-04-14 Shijun Wang , Damian Borth

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire.…

Sound · Computer Science 2020-02-18 Shindong Lee , BongGu Ko , Keonnyeong Lee , In-Chul Yoo , Dongsuk Yook

Conventional voice conversion modifies voice characteristics from a source speaker to a target speaker, relying on audio input from both sides. However, this process becomes infeasible when clean audio is unavailable, such as in silent…

Sound · Computer Science 2025-08-05 Yifan Liu , Yu Fang , Zhouhan Lin

Building a voice conversion (VC) system from non-parallel speech corpora is challenging but highly valuable in real application scenarios. In most situations, the source and the target speakers do not repeat the same texts or they may even…

Computation and Language · Computer Science 2017-06-09 Chin-Cheng Hsu , Hsin-Te Hwang , Yi-Chiao Wu , Yu Tsao , Hsin-Min Wang

In this paper, we describe our speech generation system for the first Audio Deep Synthesis Detection Challenge (ADD 2022). Firstly, we build an any-to-many voice conversion (VC) system to convert source speech with arbitrary language…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-21 Cheng Wen , Tingwei Guo , Xingjun Tan , Rui Yan , Shuran Zhou , Chuandong Xie , Wei Zou , Xiangang Li

Voice Conversion(VC) refers to changing the timbre of a speech while retaining the discourse content. Recently, many works have focused on disentangle-based learning techniques to separate the timbre and the linguistic content information…

Sound · Computer Science 2022-02-22 Huaizhen Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Voice conversion is a challenging task which transforms the voice characteristics of a source speaker to a target speaker without changing linguistic content. Recently, there have been many works on many-to-many Voice Conversion (VC) based…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Manh Luong , Viet Anh Tran

Building cross-lingual voice conversion (VC) systems for multiple speakers and multiple languages has been a challenging task for a long time. This paper describes a parallel non-autoregressive network to achieve bilingual and code-switched…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-23 Yaogen Yang , Haozhe Zhang , Xiaoyi Qin , Shanshan Liang , Huahua Cui , Mingyang Xu , Ming Li

Recent developments in neural speech synthesis and vocoding have sparked a renewed interest in voice conversion (VC). Beyond timbre transfer, achieving controllability on para-linguistic parameters such as pitch and Speed is critical in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-16 Meiying Chen , Zhiyao Duan

Humans are able to imagine a person's voice from the person's appearance and imagine the person's appearance from his/her voice. In this paper, we make the first attempt to develop a method that can convert speech into a voice that matches…

Sound · Computer Science 2019-04-10 Hirokazu Kameoka , Kou Tanaka , Aaron Valero Puche , Yasunori Ohishi , Takuhiro Kaneko

One-shot voice conversion (VC), which performs conversion across arbitrary speakers with only a single target-speaker utterance for reference, can be effectively achieved by speech representation disentanglement. Existing work generally…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-22 Disong Wang , Liqun Deng , Yu Ting Yeung , Xiao Chen , Xunying Liu , Helen Meng

Beyond the conventional voice conversion (VC) where the speaker information is converted without altering the linguistic content, the background sounds are informative and need to be retained in some real-world scenarios, such as VC in…

Sound · Computer Science 2021-11-16 Chao Xie , Yi-Chiao Wu , Patrick Lumban Tobing , Wen-Chin Huang , Tomoki Toda

Voice anonymization has been developed as a technique for preserving privacy by replacing the speaker's voice in a speech signal with that of a pseudo-speaker, thereby obscuring the original voice attributes from machine recognition and…

Sound · Computer Science 2024-11-13 Rui Wang , Liping Chen , Kong AiK Lee , Zhen-Hua Ling

Multiple studies in the past have shown that there is a strong correlation between human vocal characteristics and facial features. However, existing approaches generate faces simply from voice, without exploring the set of features that…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Hao Liang , Lulan Yu , Guikang Xu , Bhiksha Raj , Rita Singh

We propose a neural network for zero-shot voice conversion (VC) without any parallel or transcribed data. Our approach uses pre-trained models for automatic speech recognition (ASR) and speaker embedding, obtained from a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yurii Rebryk , Stanislav Beliaev