中文
相关论文

相关论文: Parallel-Data-Free Voice Conversion Using Cycle-Co…

200 篇论文

We previously proposed a method that allows for nonparallel voice conversion (VC) by using a variant of generative adversarial networks (GANs) called StarGAN. The main features of our method, called StarGAN-VC, are as follows: First, it…

音频与语音处理 · 电气工程与系统科学 2020-11-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

Emotional voice conversion aims to convert the spectrum and prosody to change the emotional patterns of speech, while preserving the speaker identity and linguistic content. Many studies require parallel speech data between different…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Kun Zhou , Berrak Sisman , Haizhou Li

We propose a novel method that combines CycleGAN and inter-domain losses for semi-supervised end-to-end automatic speech recognition. Inter-domain loss targets the extraction of an intermediate shared representation of speech and text…

计算与语言 · 计算机科学 2022-10-24 Chia-Yu Li , Ngoc Thang Vu

Voice Conversion (VC) emerged as a significant domain of research in the field of speech synthesis in recent years due to its emerging application in voice-assisting technology, automated movie dubbing, and speech-to-singing conversion to…

声音 · 计算机科学 2021-04-27 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

Speaking rate refers to the average number of phonemes within some unit time, while the rhythmic patterns refer to duration distributions for realizations of different phonemes within different phonetic structures. Both are key components…

声音 · 计算机科学 2018-08-10 Cheng-chieh Yeh , Po-chun Hsu , Ju-chieh Chou , Hung-yi Lee , Lin-shan Lee

Neural audio super-resolution models are typically trained on low- and high-resolution audio signal pairs. Although these methods achieve highly accurate super-resolution if the acoustic characteristics of the input data are similar to…

音频与语音处理 · 电气工程与系统科学 2023-02-28 Reo Yoneyama , Ryuichi Yamamoto , Kentaro Tachibana

In this paper, we present a novel technique for a non-parallel voice conversion (VC) with the use of cyclic variational autoencoder (CycleVAE)-based spectral modeling. In a variational autoencoder(VAE) framework, a latent space, usually…

音频与语音处理 · 电气工程与系统科学 2019-07-25 Patrick Lumban Tobing , Yi-Chiao Wu , Tomoki Hayashi , Kazuhiro Kobayashi , Tomoki Toda

We introduce a novel method for emotion conversion in speech that does not require parallel training data. Our approach loosely relies on a cycle-GAN schema to minimize the reconstruction error from converting back and forth between emotion…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Ravi Shankar , Jacob Sager , Archana Venkataraman

Domain adaptation plays an important role for speech recognition models, in particular, for domains that have low resources. We propose a novel generative model based on cyclic-consistent generative adversarial network (CycleGAN) for…

计算与语言 · 计算机科学 2018-07-11 Ehsan Hosseini-Asl , Yingbo Zhou , Caiming Xiong , Richard Socher

Voice conversion is a method that allows for the transformation of speaking style while maintaining the integrity of linguistic information. There are many researchers using deep generative models for voice conversion tasks. Generative…

声音 · 计算机科学 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

We propose a novel architecture and improved training objectives for non-parallel voice conversion. Our proposed CycleGAN-based model performs a shape-preserving transformation directly on a high frequency-resolution magnitude spectrogram,…

音频与语音处理 · 电气工程与系统科学 2021-08-25 Jaeseong You , Gyuhyeon Nam , Dalhyun Kim , Gyeongsu Chae

In this paper, we present a description of the baseline system of Voice Conversion Challenge (VCC) 2020 with a cyclic variational autoencoder (CycleVAE) and Parallel WaveGAN (PWG), i.e., CycleVAEPWG. CycleVAE is a nonparallel VAE-based…

声音 · 计算机科学 2020-10-12 Patrick Lumban Tobing , Yi-Chiao Wu , Tomoki Toda

Training a model to perform a task typically requires a large amount of data from the domains in which the task will be applied. However, it is often the case that data are abundant in some domains but scarce in others. Domain adaptation…

机器学习 · 计算机科学 2019-01-25 Ehsan Hosseini-Asl , Yingbo Zhou , Caiming Xiong , Richard Socher

Preserving the linguistic content of input speech is essential during voice conversion (VC). The star generative adversarial network-based VC method (StarGAN-VC) is a recently developed method that allows non-parallel many-to-many VC.…

声音 · 计算机科学 2023-01-18 Shoki Sakamoto , Akira Taniguchi , Tadahiro Taniguchi , Hirokazu Kameoka

Non-parallel training is a difficult but essential task for DNN-based speech enhancement methods, for the lack of adequate noisy and paired clean speech corpus in many real scenarios. In this paper, we propose a novel adaptive…

声音 · 计算机科学 2021-09-15 Guochen Yu , Yutian Wang , Chengshi Zheng , Hui Wang , Qin Zhang

Voice Conversion (VC) aims to convert the style of a source speaker, such as timbre and pitch, to the style of any target speaker while preserving the linguistic content. However, the ground truth of the converted speech does not exist in a…

声音 · 计算机科学 2025-01-06 Ziqi Liang , Xulong Zhang , Chang Liu , Xiaoyang Qu , Weifeng Zhao , Jianzong Wang

Non-parallel voice conversion (VC) is typically achieved using lossy representations of the source speech. However, ensuring only speaker identity information is dropped whilst all other information from the source speech is retained is a…

音频与语音处理 · 电气工程与系统科学 2022-03-16 Thomas Merritt , Abdelhamid Ezzerg , Piotr Biliński , Magdalena Proszewska , Kamil Pokora , Roberto Barra-Chicote , Daniel Korzekwa

For the lack of adequate paired noisy-clean speech corpus in many real scenarios, non-parallel training is a promising task for DNN-based speech enhancement methods. However, because of the severe mismatch between input and target speeches,…

声音 · 计算机科学 2022-02-15 Guochen Yu , Andong Li , Yutian Wang , Yinuo Guo , Hui Wang , Chengshi Zheng

With the increase in the availability of speech from varied domains, it is imperative to use such out-of-domain data to improve existing speech systems. Domain adaptation is a prominent pre-processing approach for this. We investigate it…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Saurabh Kataria , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velázquez , Najim Dehak

This paper evaluates the effectiveness of a Cycle-GAN based voice converter (VC) on four speaker identification (SID) systems and an automated speech recognition (ASR) system for various purposes. Audio samples converted by the VC model are…

音频与语音处理 · 电气工程与系统科学 2019-05-30 Gokce Keskin , Tyler Lee , Cory Stephenson , Oguz H. Elibol