中文
相关论文

相关论文: CycleGAN-VC2: Improved CycleGAN-based Non-parallel…

200 篇论文

Unpaired image-to-image translation has broad applications in art, design, and scientific simulations. One early breakthrough was CycleGAN that emphasizes one-to-one mappings between two unpaired image domains via generative-adversarial…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Dmitrii Torbunov , Yi Huang , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

Numerous voice conversion (VC) techniques have been proposed for the conversion of voices among different speakers. Although good quality of the converted speech can be observed when VC is applied in a clean environment, the quality…

音频与语音处理 · 电气工程与系统科学 2023-01-20 Yun-Ju Chan , Chiang-Jen Peng , Syu-Siang Wang , Hsin-Min Wang , Yu Tsao , Tai-Shih Chi

In this work we introduce a semi-supervised approach to the voice conversion problem, in which speech from a source speaker is converted into speech of a target speaker. The proposed method makes use of both parallel and non-parallel…

机器学习 · 统计学 2019-10-02 Cory Stephenson , Gokce Keskin , Anil Thomas , Oguz H. Elibol

Building a voice conversion (VC) system from non-parallel speech corpora is challenging but highly valuable in real application scenarios. In most situations, the source and the target speakers do not repeat the same texts or they may even…

计算与语言 · 计算机科学 2017-06-09 Chin-Cheng Hsu , Hsin-Te Hwang , Yi-Chiao Wu , Yu Tsao , Hsin-Min Wang

Non-parallel many-to-many voice conversion remains an interesting but challenging speech processing task. Many style-transfer-inspired methods such as generative adversarial networks (GANs) and variational autoencoders (VAEs) have been…

音频与语音处理 · 电气工程与系统科学 2020-04-17 Kaizhi Qian , Zeyu Jin , Mark Hasegawa-Johnson , Gautham J. Mysore

Applying changes to an input speech signal to change the perceived speaker of speech to a target while maintaining the content of the input is a challenging but interesting task known as Voice conversion (VC). Over the last few years, this…

声音 · 计算机科学 2022-12-29 Olga Slizovskaia , Jordi Janer , Pritish Chandna , Oscar Mayor

Recently, voice conversion (VC) without parallel data has been successfully adapted to multi-target scenario in which a single model is trained to convert the input voice to many different speakers. However, such model suffers from the…

机器学习 · 计算机科学 2019-08-23 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee

Any-to-any voice conversion aims to transform source speech into a target voice with just a few examples of the target speaker as a reference. Recent methods produce convincing conversions, but at the cost of increased complexity -- making…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Matthew Baas , Benjamin van Niekerk , Herman Kamper

We propose a novel method that combines CycleGAN and inter-domain losses for semi-supervised end-to-end automatic speech recognition. Inter-domain loss targets the extraction of an intermediate shared representation of speech and text…

计算与语言 · 计算机科学 2022-10-24 Chia-Yu Li , Ngoc Thang Vu

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

音频与语音处理 · 电气工程与系统科学 2020-06-16 Luka Chkhetiani , Levan Bejanidze

In this paper, we propose a novel voice conversion strategy to resolve the mismatch between the training and conversion scenarios when parallel speech corpus is unavailable for training. Based on auto-encoder and disentanglement frameworks,…

音频与语音处理 · 电气工程与系统科学 2020-11-05 Yoohwan Kwon , Soo-Whan Chung , Hee-Soo Heo , Hong-Goo Kang

This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with…

音频与语音处理 · 电气工程与系统科学 2021-01-07 Mingyang Zhang , Yi Zhou , Li Zhao , Haizhou Li

As parallel training data is scarce for one-shot voice conversion (VC) tasks, waveform reconstruction is typically performed by various VC systems. A typical one-shot VC system comprises a content encoder and a speaker encoder. However, two…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Songjun Cao , Qinghua Wu , Jie Chen , Jin Li , Long Ma

Cycle-consistent generative adversarial networks (CycleGAN) have shown their promising performance for speech enhancement (SE), while one intractable shortcoming of these CycleGAN-based SE systems is that the noise components propagate…

声音 · 计算机科学 2021-09-07 Guochen Yu , Yutian Wang , Hui Wang , Qin Zhang , Chengshi Zheng

Generative Adversarial Networks (GANs) are machine learning networks based around creating synthetic data. Voice Conversion (VC) is a subset of voice translation that involves translating the paralinguistic features of a source speaker to a…

声音 · 计算机科学 2021-02-24 Samuel J. Broughton , Md Asif Jalal , Roger K. Moore

Voice conversion (VC) and text-to-speech (TTS) are two tasks that share a similar objective, generating speech with a target voice. However, they are usually developed independently under vastly different frameworks. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2019-09-17 Hieu-Thi Luong , Junichi Yamagishi

Nonparallel multi-domain voice conversion methods such as the StarGAN-VCs have been widely applied in many scenarios. However, the training of these models usually poses a challenge due to their complicated adversarial network…

音频与语音处理 · 电气工程与系统科学 2022-09-28 Shijing Si , Jianzong Wang , Xulong Zhang , Xiaoyang Qu , Ning Cheng , Jing Xiao

Whisper to normal speech conversion is an active area of research. Various architectures based on generative adversarial networks have been proposed in the recent past. Especially, recent study shows that MaskCycleGAN, which is a mask…

音频与语音处理 · 电气工程与系统科学 2024-08-28 K. Rohith Gupta , K. Ramnath , S. Johanan Joysingh , P. Vijayalakshmi , T. Nagarajan

Automatic speech recognition (ASR) needs to be robust to speaker differences. Voice Conversion (VC) modifies speaker characteristics of input speech. This is an attractive feature for ASR data augmentation. In this paper, we demonstrate…

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

声音 · 计算机科学 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel