中文
相关论文

相关论文: AVQVC: One-shot Voice Conversion by Vector Quantiz…

200 篇论文

Voice Conversion (VC) modifies speech to match a target speaker while preserving linguistic content. Traditional methods usually extract speaker information directly from speech while neglecting the explicit utilization of linguistic…

多媒体 · 计算机科学 2025-06-04 Fengjin Li , Jie Wang , Yadong Niu , Yongqing Wang , Meng Meng , Jian Luan , Zhiyong Wu

The imitation of voice, targeted on specific speech attributes such as timbre and speaking style, is crucial in speech generation. However, existing methods rely heavily on annotated data, and struggle with effectively disentangling timbre…

Voice Conversion (VC) aims to modify a speaker's timbre while preserving linguistic content. While recent VC models achieve strong performance, most struggle in real-time streaming scenarios due to high latency, dependence on ASR modules,…

声音 · 计算机科学 2025-10-13 Zhao Guo , Ziqian Ning , Guobin Ma , Lei Xie

Traditional studies on voice conversion (VC) have made progress with parallel training data and known speakers. Good voice conversion quality is obtained by exploring better alignment modules or expressive mapping functions. In this study,…

音频与语音处理 · 电气工程与系统科学 2022-04-01 Jiachen Lian , Chunlei Zhang , Dong Yu

We propose SelfVC, a training strategy to iteratively improve a voice conversion model with self-synthesized examples. Previous efforts on voice conversion focus on factorizing speech into explicitly disentangled representations that…

Expressive zero-shot voice conversion (VC) is a critical and challenging task that aims to transform the source timbre into an arbitrary unseen speaker while preserving the original content and expressive qualities. Despite recent progress…

声音 · 计算机科学 2025-01-13 Yuguang Yang , Yu Pan , Jixun Yao , Xiang Zhang , Jianhao Ye , Hongbin Zhou , Lei Xie , Lei Ma , Jianjun Zhao

Recently, voice conversion (VC) has been widely studied. Many VC systems use disentangle-based learning techniques to separate the speaker and the linguistic content information from a speech signal. Subsequently, they convert the voice by…

音频与语音处理 · 电气工程与系统科学 2020-11-03 Yen-Hao Chen , Da-Yi Wu , Tsung-Han Wu , Hung-yi Lee

Despite recent advances in zero-shot voice conversion (VC), achieving speaker similarity and naturalness comparable to ground-truth recordings remains a significant challenge. In this letter, we propose CTEFM-VC, a zero-shot VC framework…

声音 · 计算机科学 2025-08-12 Yu Pan , Yuguang Yang , Jixun Yao , Lei Ma , Jianjun Zhao

As a foundational technology for intelligent human-computer interaction, voice conversion (VC) seeks to transform speech from any source timbre into any target timbre. Traditional voice conversion methods based on Generative Adversarial…

声音 · 计算机科学 2025-06-11 Wenhan Yao , Fen Xiao , Xiarun Chen , Jia Liu , YongQiang He , Weiping Wen

One-shot voice conversion aims to change the timbre of any source speech to match that of the unseen target speaker with only one speech sample. Existing methods face difficulties in satisfactory speech representation disentanglement and…

声音 · 计算机科学 2024-11-26 Pengcheng Li , Jianzong Wang , Xulong Zhang , Yong Zhang , Jing Xiao , Ning Cheng

The goal of voice conversion (VC) is to convert input voice to match the target speaker's voice while keeping text and prosody intact. VC is usually used in entertainment and speaking-aid systems, as well as applied for speech data…

声音 · 计算机科学 2022-04-01 A. Kashkin , I. Karpukhin , S. Shishkin

We propose a new speech discrete token vocoder, vec2wav 2.0, which advances voice conversion (VC). We use discrete tokens from speech self-supervised models as the content features of source speech, and treat VC as a prompted vocoding task.…

音频与语音处理 · 电气工程与系统科学 2025-05-27 Yiwei Guo , Zhihan Li , Junjie Li , Chenpeng Du , Hankun Wang , Shuai Wang , Xie Chen , Kai Yu

Unsupervised Zero-Shot Voice Conversion (VC) aims to modify the speaker characteristic of an utterance to match an unseen target speaker without relying on parallel training data. Recently, self-supervised learning of speech representation…

声音 · 计算机科学 2022-02-14 Trung Dang , Dung Tran , Peter Chin , Kazuhito Koishida

Speech tokenization is crucial in digital speech processing, converting continuous speech signals into discrete units for various computational tasks. This paper introduces a novel speech tokenizer with broad applicability across downstream…

机器学习 · 计算机科学 2025-07-10 Wonjin Jung , Sungil Kang , Dong-Yeon Cho

Style voice conversion aims to transform the speaking style of source speech into a desired style while keeping the original speaker's identity. However, previous style voice conversion approaches primarily focus on well-defined domains…

音频与语音处理 · 电气工程与系统科学 2025-01-09 Xinfa Zhu , Lei He , Yujia Xiao , Xi Wang , Xu Tan , Sheng Zhao , Lei Xie

Applying changes to an input speech signal to change the perceived speaker of speech to a target while maintaining the content of the input is a challenging but interesting task known as Voice conversion (VC). Over the last few years, this…

声音 · 计算机科学 2022-12-29 Olga Slizovskaia , Jordi Janer , Pritish Chandna , Oscar Mayor

Any-to-any voice conversion problem aims to convert voices for source and target speakers, which are out of the training data. Previous works wildly utilize the disentangle-based models. The disentangle-based model assumes the speech…

声音 · 计算机科学 2022-02-23 Qiqi Wang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

We introduce HybridVC, a voice conversion (VC) framework built upon a pre-trained conditional variational autoencoder (CVAE) that combines the strengths of a latent model with contrastive learning. HybridVC supports text and audio prompts,…

声音 · 计算机科学 2024-09-26 Xinlei Niu , Jing Zhang , Charles Patrick Martin

Traditional voice conversion (VC) methods typically attempt to separate speaker identity and linguistic information into distinct representations, which are then combined to reconstruct the audio. However, effectively disentangling these…

声音 · 计算机科学 2025-10-13 Huu Tuong Tu , Huan Vu , cuong tien nguyen , Dien Hy Ngo , Nguyen Thi Thu Trang

Zero-shot voice conversion (VC) aims to transform source speech into arbitrary unseen target voice while keeping the linguistic content unchanged. Recent VC methods have made significant progress, but semantic losses in the decoupling…

声音 · 计算机科学 2024-06-17 Linhan Ma , Xinfa Zhu , Yuanjun Lv , Zhichao Wang , Ziqian Wang , Wendi He , Hongbin Zhou , Lei Xie