中文
相关论文

相关论文: StarGAN-ZSVC: Towards Zero-Shot Voice Conversion i…

200 篇论文

Zero-shot voice conversion is becoming an increasingly popular research topic, as it promises the ability to transform speech to sound like any speaker. However, relatively little work has been done on end-to-end methods for this task,…

音频与语音处理 · 电气工程与系统科学 2024-04-04 Wonjune Kang , Mark Hasegawa-Johnson , Deb Roy

Unsupervised Zero-Shot Voice Conversion (VC) aims to modify the speaker characteristic of an utterance to match an unseen target speaker without relying on parallel training data. Recently, self-supervised learning of speech representation…

声音 · 计算机科学 2022-02-14 Trung Dang , Dung Tran , Peter Chin , Kazuhito Koishida

Voice conversion (VC) is a task that transforms voice from target audio to source without losing linguistic contents, it is challenging especially when source and target speakers are unseen during training (zero-shot VC). Previous…

声音 · 计算机科学 2021-04-14 Shijun Wang , Damian Borth

Zero-shot voice conversion (VC) aims to transfer the timbre from the source speaker to an arbitrary unseen speaker while preserving the original linguistic content. Despite recent advancements in zero-shot VC using language model-based or…

音频与语音处理 · 电气工程与系统科学 2024-12-11 Jixun Yao , Yuguang Yang , Yu Pan , Ziqian Ning , Jiaohao Ye , Hongbin Zhou , Lei Xie

Voice Conversion (VC) is a technique that aims to transform the non-linguistic information of a source utterance to change the perceived identity of the speaker. While there is a rich literature on VC, most proposed methods are trained and…

Recently, voice conversion (VC) without parallel data has been successfully adapted to multi-target scenario in which a single model is trained to convert the input voice to many different speakers. However, such model suffers from the…

机器学习 · 计算机科学 2019-08-23 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee

Emotional Voice Conversion (EVC) aims to convert the emotional style of a source speech signal to a target style while preserving its content and speaker identity information. Previous emotional conversion studies do not disentangle…

声音 · 计算机科学 2021-07-20 Xiangheng He , Junjie Chen , Georgios Rizos , Björn W. Schuller

Voice conversion is to generate a new speech with the source content and a target voice style. In this paper, we focus on one general setting, i.e., non-parallel many-to-many voice conversion, which is close to the real-world scenario. As…

声音 · 计算机科学 2022-07-28 Jian Ma , Zhedong Zheng , Hao Fei , Feng Zheng , Tat-seng Chua , Yi Yang

Zero-shot singing voice conversion (SVC) transforms a source singer's timbre to an unseen target speaker's voice while preserving melodic content without fine-tuning. Existing methods model speaker timbre and vocal content separately,…

声音 · 计算机科学 2025-11-18 Bingsong Bai , Yizhong Geng , Fengping Wang , Cong Wang , Puyuan Guo , Yingming Gao , Ya Li

The zero-shot scenario for speech generation aims at synthesizing a novel unseen voice with only one utterance of the target speaker. Although the challenges of adapting new voices in zero-shot scenario exist in both stages -- acoustic…

声音 · 计算机科学 2022-07-06 Yi Lei , Shan Yang , Jian Cong , Lei Xie , Dan Su

Zero-Shot Voice Conversion (VC) aims to transform the source speaker's timbre into an arbitrary unseen one while retaining speech content. Most prior work focuses on preserving the source's prosody, while fine-grained timbre information may…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Jialong Zuo , Shengpeng Ji , Minghui Fang , Mingze Li , Ziyue Jiang , Xize Cheng , Xiaoda Yang , Chen Feiyang , Xinyu Duan , Zhou Zhao

In recent years, large-scale pre-trained speech language models (SLMs) have demonstrated remarkable advancements in various generative speech modeling applications, such as text-to-speech synthesis, voice conversion, and speech enhancement.…

音频与语音处理 · 电气工程与系统科学 2023-07-19 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Voice Conversion (VC) emerged as a significant domain of research in the field of speech synthesis in recent years due to its emerging application in voice-assisting technology, automated movie dubbing, and speech-to-singing conversion to…

声音 · 计算机科学 2021-04-27 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

Voice conversion (VC) could be used to improve speech recognition systems in low-resource languages by using it to augment limited training data. However, VC has not been widely used for this purpose because of practical issues such as…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Matthew Baas , Herman Kamper

Voice Conversion (VC) for unseen speakers, also known as zero-shot VC, is an attractive research topic as it enables a range of applications like voice customizing, animation production, and others. Recent work in this area made progress…

声音 · 计算机科学 2022-06-01 Shijun Wang , Dimche Kostadinov , Damian Borth

Voice conversion (VC) systems are widely used for several applications, from speaker anonymisation to personalised speech synthesis. Supervised approaches learn a mapping between different speakers using parallel data, which is expensive to…

Non-parallel voice conversion (VC) is a technique for learning the mapping from source to target speech without relying on parallel data. This is an important task, but it has been challenging due to the disadvantages of the training…

声音 · 计算机科学 2019-04-10 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

We introduce MaskVCT, a zero-shot voice conversion (VC) model that offers multi-factor controllability through multiple classifier-free guidances (CFGs). While previous VC models rely on a fixed conditioning scheme, MaskVCT integrates…

音频与语音处理 · 电气工程与系统科学 2026-02-12 Junhyeok Lee , Helin Wang , Yaohan Guan , Thomas Thebaud , Laureano Moro-Velazquez , Jesús Villalba , Najim Dehak

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire.…

声音 · 计算机科学 2020-02-18 Shindong Lee , BongGu Ko , Keonnyeong Lee , In-Chul Yoo , Dongsuk Yook

Zero-shot voice conversion aims to transform a source speech utterance to match the timbre of a reference speech from an unseen speaker. Traditional approaches struggle with timbre leakage, insufficient timbre representation, and mismatches…

声音 · 计算机科学 2024-11-18 Songting Liu