中文
相关论文

相关论文: StableVC: Style Controllable Zero-Shot Voice Conve…

200 篇论文

Singing voice conversion (SVC) aims to render the target singer's timbre while preserving melody and lyrics. However, existing zero-shot SVC systems remain fragile in real songs due to harmony interference, F0 errors, and the lack of…

One-shot voice conversion(VC) aims to change the timbre of any source speech to match that of the target speaker with only one speech sample. Existing style transfer-based VC methods relied on speech representation disentanglement and…

声音 · 计算机科学 2024-11-26 Wenhan Yao , Zedong Xing , Xiarun Chen , Jia Liu , Yongqiang He , Weiping Wen

Unsupervised Zero-Shot Voice Conversion (VC) aims to modify the speaker characteristic of an utterance to match an unseen target speaker without relying on parallel training data. Recently, self-supervised learning of speech representation…

声音 · 计算机科学 2022-02-14 Trung Dang , Dung Tran , Peter Chin , Kazuhito Koishida

One-shot voice conversion (VC) aims to convert speech from any source speaker to an arbitrary target speaker with only a few seconds of reference speech from the target speaker. This relies heavily on disentangling the speaker's identity…

音频与语音处理 · 电气工程与系统科学 2023-01-02 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Voice conversion (VC) is a task that transforms voice from target audio to source without losing linguistic contents, it is challenging especially when source and target speakers are unseen during training (zero-shot VC). Previous…

声音 · 计算机科学 2021-04-14 Shijun Wang , Damian Borth

Zero-shot voice conversion aims to transfer the voice of a source speaker to that of a speaker unseen during training, while preserving the content information. Although various methods have been proposed to reconstruct speaker information…

声音 · 计算机科学 2024-08-22 Anastasia Avdeeva , Aleksei Gusev

Voice style conversion aims to transform an input utterance to match a target speaker's timbre, accent, and emotion, with a central challenge being the disentanglement of linguistic content from style. While prior work has explored this…

声音 · 计算机科学 2026-02-24 Yisi Liu , Nicholas Lee , Gopala Anumanchipalli

Voice conversion is the task of converting a spoken utterance from a source speaker so that it appears to be said by a different target speaker while retaining the linguistic content of the utterance. Recent advances have led to major…

音频与语音处理 · 电气工程与系统科学 2021-06-02 Matthew Baas , Herman Kamper

This study presents an innovative Zero-Shot any-to-any Singing Voice Conversion (SVC) method, leveraging a novel clustering-based phoneme representation to effectively separate content, timbre, and singing style. This approach enables…

声音 · 计算机科学 2024-10-15 Wangjin Zhou , Fengrun Zhang , Yiming Liu , Wenhao Guan , Yi Zhao , Tatsuya Kawahara

Singing Voice Conversion (SVC) transfers a source singer's timbre to a target while keeping melody and lyrics. The key challenge in any-to-any SVC is adapting unseen speaker timbres to source audio without quality degradation. Existing…

声音 · 计算机科学 2025-08-11 Wei Chen , Binzhu Sha , Dan Luo , Jing Yang , Zhuo Wang , Fan Fan , Zhiyong Wu

We propose a neural network for zero-shot voice conversion (VC) without any parallel or transcribed data. Our approach uses pre-trained models for automatic speech recognition (ASR) and speaker embedding, obtained from a speaker…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Yurii Rebryk , Stanislav Beliaev

Voice Conversion(VC) refers to changing the timbre of a speech while retaining the discourse content. Recently, many works have focused on disentangle-based learning techniques to separate the timbre and the linguistic content information…

声音 · 计算机科学 2022-02-22 Huaizhen Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Zero-shot voice conversion is becoming an increasingly popular research topic, as it promises the ability to transform speech to sound like any speaker. However, relatively little work has been done on end-to-end methods for this task,…

音频与语音处理 · 电气工程与系统科学 2024-04-04 Wonjune Kang , Mark Hasegawa-Johnson , Deb Roy

Voice Conversion (VC) for unseen speakers, also known as zero-shot VC, is an attractive research topic as it enables a range of applications like voice customizing, animation production, and others. Recent work in this area made progress…

声音 · 计算机科学 2022-06-01 Shijun Wang , Dimche Kostadinov , Damian Borth

Voice Conversion (VC) modifies speech to match a target speaker while preserving linguistic content. Traditional methods usually extract speaker information directly from speech while neglecting the explicit utilization of linguistic…

多媒体 · 计算机科学 2025-06-04 Fengjin Li , Jie Wang , Yadong Niu , Yongqing Wang , Meng Meng , Jian Luan , Zhiyong Wu

StreamVoice has recently pushed the boundaries of zero-shot voice conversion (VC) in the streaming domain. It uses a streamable language model (LM) with a context-aware approach to convert semantic features from automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2024-08-06 Zhichao Wang , Yuanzhe Chen , Xinsheng Wang , Lei Xie , Yuping Wang

Traditional studies on voice conversion (VC) have made progress with parallel training data and known speakers. Good voice conversion quality is obtained by exploring better alignment modules or expressive mapping functions. In this study,…

音频与语音处理 · 电气工程与系统科学 2022-04-01 Jiachen Lian , Chunlei Zhang , Dong Yu

Conveying the linguistic content and maintaining the source speech's speaking style, such as intonation and emotion, is essential in voice conversion (VC). However, in a low-resource situation, where only limited utterances from the target…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Zhichao Wang , Xinsheng Wang , Lei Xie , Yuanzhe Chen , Qiao Tian , Yuping Wang

Most current zero-shot voice conversion methods rely on externally supervised components, particularly speaker encoders, for training. To explore alternatives that eliminate this dependency, this paper introduces GenVC, a novel framework…

音频与语音处理 · 电气工程与系统科学 2025-08-21 Zexin Cai , Henry Li Xinyuan , Ashi Garg , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

In real-world voice conversion applications, environmental noise in source speech and user demands for expressive output pose critical challenges. Traditional ASR-based methods ensure noise robustness but suppress prosody richness, while…

音频与语音处理 · 电气工程与系统科学 2025-08-11 Yuepeng Jiang , Ziqian Ning , Shuai Wang , Chengjia Wang , Mengxiao Bi , Pengcheng Zhu , Zhonghua Fu , Lei Xie