中文
相关论文

相关论文: Rhythm-Flexible Voice Conversion without Parallel …

200 篇论文

Non-parallel voice conversion (VC) is a technique for training voice converters without a parallel corpus. Cycle-consistent adversarial network-based VCs (CycleGAN-VC and CycleGAN-VC2) are widely accepted as benchmark methods. However,…

声音 · 计算机科学 2021-02-26 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

Autoregressive neural vocoders have achieved outstanding performance in speech synthesis tasks such as text-to-speech and voice conversion. An autoregressive vocoder predicts a sample at some time step conditioned on those at previous time…

声音 · 计算机科学 2024-06-06 Po-chun Hsu , Da-rong Liu , Andy T. Liu , Hung-yi Lee

This paper proposes a speech rhythm-based method for speaker embeddings to model phoneme duration using a few utterances by the target speaker. Speech rhythm is one of the essential factors among speaker characteristics, along with acoustic…

声音 · 计算机科学 2024-02-13 Kenichi Fujita , Atsushi Ando , Yusuke Ijima

This paper focuses on using voice conversion (VC) to improve the speech intelligibility of surgical patients who have had parts of their articulators removed. Due to the difficulty of data collection, VC without parallel data is highly…

音频与语音处理 · 电气工程与系统科学 2019-08-26 Li-Wei Chen , Hung-Yi Lee , Yu Tsao

We present a Cycle-GAN based many-to-many voice conversion method that can convert between speakers that are not in the training set. This property is enabled through speaker embeddings generated by a neural network that is jointly trained…

音频与语音处理 · 电气工程与系统科学 2019-05-08 Gokce Keskin , Tyler Lee , Cory Stephenson , Oguz H. Elibol

Voice conversion is to generate a new speech with the source content and a target voice style. In this paper, we focus on one general setting, i.e., non-parallel many-to-many voice conversion, which is close to the real-world scenario. As…

声音 · 计算机科学 2022-07-28 Jian Ma , Zhedong Zheng , Hao Fei , Feng Zheng , Tat-seng Chua , Yi Yang

Whisper to normal speech conversion is an active area of research. Various architectures based on generative adversarial networks have been proposed in the recent past. Especially, recent study shows that MaskCycleGAN, which is a mask…

音频与语音处理 · 电气工程与系统科学 2024-08-28 K. Rohith Gupta , K. Ramnath , S. Johanan Joysingh , P. Vijayalakshmi , T. Nagarajan

In this paper, we investigate several existing and a new state-of-the-art generative adversarial network-based (GAN) voice conversion method for enhancing dysarthric speech for improved dysarthric speech recognition. We compare key…

声音 · 计算机科学 2022-01-14 Luke Prananta , Bence Mark Halpern , Siyuan Feng , Odette Scharenborg

This paper presents a method to train end-to-end automatic speech recognition (ASR) models using unpaired data. Although the end-to-end approach can eliminate the need for expert knowledge such as pronunciation dictionaries to build ASR…

计算与语言 · 计算机科学 2019-05-24 Takaaki Hori , Ramon Astudillo , Tomoki Hayashi , Yu Zhang , Shinji Watanabe , Jonathan Le Roux

Singing voice conversion is a task to convert a song sang by a source singer to the voice of a target singer. In this paper, we propose using a parallel data free, many-to-one voice conversion technique on singing voices. A phonetic…

音频与语音处理 · 电气工程与系统科学 2019-03-12 Xin Chen , Wei Chu , Jinxi Guo , Ning Xu

Recent efforts in Spoken Dialogue Modeling aim to synthesize spoken dialogue without the need for direct transcription, thereby preserving the wealth of non-textual information inherent in speech. However, this approach faces a challenge…

计算与语言 · 计算机科学 2024-07-03 Yu-Kuan Fu , Cheng-Kuang Lee , Hsiu-Hsuan Wang , Hung-yi Lee

We propose a novel architecture and improved training objectives for non-parallel voice conversion. Our proposed CycleGAN-based model performs a shape-preserving transformation directly on a high frequency-resolution magnitude spectrogram,…

音频与语音处理 · 电气工程与系统科学 2021-08-25 Jaeseong You , Gyuhyeon Nam , Dalhyun Kim , Gyeongsu Chae

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

音频与语音处理 · 电气工程与系统科学 2020-06-16 Luka Chkhetiani , Levan Bejanidze

This paper presents a method of sequence-to-sequence (seq2seq) voice conversion using non-parallel training data. In this method, disentangled linguistic and speaker representations are extracted from acoustic features, and voice conversion…

音频与语音处理 · 电气工程与系统科学 2020-01-14 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

We propose a learning-based filter that allows us to directly modify a synthetic speech waveform into a natural speech waveform. Speech-processing systems using a vocoder framework such as statistical parametric speech synthesis and voice…

音频与语音处理 · 电气工程与系统科学 2018-10-02 Kou Tanaka , Takuhiro Kaneko , Nobukatsu Hojo , Hirokazu Kameoka

In a typical voice conversion system, vocoder is commonly used for speech-to-features analysis and features-to-speech synthesis. However, vocoder can be a source of speech quality degradation. This paper presents a vocoder-free voice…

音频与语音处理 · 电气工程与系统科学 2019-09-18 Xiaohai Tian , Eng Siong Chng , Haizhou Li

Some recent studies have demonstrated the feasibility of single-stage neural text-to-speech, which does not need to generate mel-spectrograms but generates the raw waveforms directly from the text. Single-stage text-to-speech often faces…

声音 · 计算机科学 2022-07-14 Zhengxi Liu , Qiao Tian , Chenxu Hu , Xudong Liu , Menglin Wu , Yuping Wang , Hang Zhao , Yuxuan Wang

Modern sequence to sequence neural TTS systems provide close to natural speech quality. Such systems usually comprise a network converting linguistic/phonetic features sequence to an acoustic features sequence, cascaded with a neural…

音频与语音处理 · 电气工程与系统科学 2019-09-26 Slava Shechtman , Alex Sorin

This paper investigates the use of generative adversarial network (GAN)-based models for converting the spectrogram of a speech signal into that of a singing one, without reference to the phoneme sequence underlying the speech. This is…

音频与语音处理 · 电气工程与系统科学 2020-08-06 Da-Yi Wu , Yi-Hsuan Yang

Non-parallel training is a difficult but essential task for DNN-based speech enhancement methods, for the lack of adequate noisy and paired clean speech corpus in many real scenarios. In this paper, we propose a novel adaptive…

声音 · 计算机科学 2021-09-15 Guochen Yu , Yutian Wang , Chengshi Zheng , Hui Wang , Qin Zhang