中文
相关论文

相关论文: Vocoder-Free Non-Parallel Conversion of Whispered …

200 篇论文

Recent advances in speech synthesis suggest that limitations such as the lossy nature of the amplitude spectrum with minimum phase approximation and the over-smoothing effect in acoustic modeling can be overcome by using advanced machine…

音频与语音处理 · 电气工程与系统科学 2018-04-10 Xin Wang , Jaime Lorenzo-Trueba , Shinji Takaki , Lauri Juvela , Junichi Yamagishi

This paper proposes voicing-aware conditional discriminators for Parallel WaveGAN-based waveform synthesis systems. In this framework, we adopt a projection-based conditioning method that can significantly improve the discriminator's…

音频与语音处理 · 电气工程与系统科学 2021-04-27 Ryuichi Yamamoto , Eunwoo Song , Min-Jae Hwang , Jae-Min Kim

We present an approach to synthesize whisper by applying a handcrafted signal processing recipe and Voice Conversion (VC) techniques to convert normally phonated speech to whispered speech. We investigate using Gaussian Mixture Models (GMM)…

Voice conversion (VC) using sequence-to-sequence learning of context posterior probabilities is proposed. Conventional VC using shared context posterior probabilities predicts target speech parameters from the context posterior…

声音 · 计算机科学 2017-08-08 Hiroyuki Miyoshi , Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Recent advances in neural network -based text-to-speech have reached human level naturalness in synthetic speech. The present sequence-to-sequence models can directly map text to mel-spectrogram acoustic features, which are convenient for…

音频与语音处理 · 电气工程与系统科学 2019-06-27 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

Voice Conversion (VC) aims to convert the style of a source speaker, such as timbre and pitch, to the style of any target speaker while preserving the linguistic content. However, the ground truth of the converted speech does not exist in a…

声音 · 计算机科学 2025-01-06 Ziqi Liang , Xulong Zhang , Chang Liu , Xiaoyang Qu , Weifeng Zhao , Jianzong Wang

Singing voice conversion aims to convert singer's voice from source to target without changing singing content. Parallel training data is typically required for the training of singing voice conversion system, that is however not practical…

音频与语音处理 · 电气工程与系统科学 2020-11-04 Junchen Lu , Kun Zhou , Berrak Sisman , Haizhou Li

Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generating images that are…

声音 · 计算机科学 2019-02-12 Chris Donahue , Julian McAuley , Miller Puckette

Machine recognition of an atypical speech like whispered speech, is a challenging task. We introduce whisper-to-natural-speech conversion using sequence-to-sequence approach by proposing enhanced transformer architecture, which uses both…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Abhishek Niranjan , Mukesh Sharma , Sai Bharath Chandra Gutha , M Ali Basha Shaik

We present an unsupervised non-parallel many-to-many voice conversion (VC) method using a generative adversarial network (GAN) called StarGAN v2. Using a combination of adversarial source classifier loss and perceptual loss, our model…

声音 · 计算机科学 2021-07-26 Yinghao Aaron Li , Ali Zare , Nima Mesgarani

Generative models are a popular choice for adult-to-adult voice conversion (VC) because of their efficient way of modelling unlabelled data. To this point their usefulness in producing children speech and in particular adult to child VC has…

声音 · 计算机科学 2025-12-16 Protima Nomo Sudro , Anton Ragni , Thomas Hain

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain…

音频与语音处理 · 电气工程与系统科学 2020-05-20 Songxiang Liu , Yuewen Cao , Shiyin Kang , Na Hu , Xunying Liu , Dan Su , Dong Yu , Helen Meng

Recent neural networks such as WaveNet and sampleRNN that learn directly from speech waveform samples have achieved very high-quality synthetic speech in terms of both naturalness and speaker similarity even in multi-speaker text-to-speech…

音频与语音处理 · 电气工程与系统科学 2018-08-01 Yi Zhao , Shinji Takaki , Hieu-Thi Luong , Junichi Yamagishi , Daisuke Saito , Nobuaki Minematsu

In this paper, we present a description of the baseline system of Voice Conversion Challenge (VCC) 2020 with a cyclic variational autoencoder (CycleVAE) and Parallel WaveGAN (PWG), i.e., CycleVAEPWG. CycleVAE is a nonparallel VAE-based…

声音 · 计算机科学 2020-10-12 Patrick Lumban Tobing , Yi-Chiao Wu , Tomoki Toda

This paper proposes a method that allows non-parallel many-to-many voice conversion (VC) by using a variant of a generative adversarial network (GAN) called StarGAN. Our method, which we call StarGAN-VC, is noteworthy in that it (1)…

声音 · 计算机科学 2018-07-02 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

Voice impersonation is not the same as voice transformation, although the latter is an essential element of it. In voice impersonation, the resultant voice must convincingly convey the impression of having been naturally produced by the…

声音 · 计算机科学 2018-02-21 Yang Gao , Rita Singh , Bhiksha Raj

We propose a novel architecture and improved training objectives for non-parallel voice conversion. Our proposed CycleGAN-based model performs a shape-preserving transformation directly on a high frequency-resolution magnitude spectrogram,…

音频与语音处理 · 电气工程与系统科学 2021-08-25 Jaeseong You , Gyuhyeon Nam , Dalhyun Kim , Gyeongsu Chae

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

声音 · 计算机科学 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel

This paper proposes a source-filter-based generative adversarial neural vocoder named SF-GAN, which achieves high-fidelity waveform generation from input acoustic features by introducing F0-based source excitation signals to a neural filter…

音频与语音处理 · 电气工程与系统科学 2023-05-24 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

Most methods of voice restoration for patients suffering from aphonia either produce whispered or monotone speech. Apart from intelligibility, this type of speech lacks expressiveness and naturalness due to the absence of pitch (whispered…

声音 · 计算机科学 2018-11-07 Santiago Pascual , Antonio Bonafonte , Joan Serrà , Jose A. Gonzalez