中文
相关论文

相关论文: Source-Filter-Based Generative Adversarial Neural …

200 篇论文

Recent development of neural vocoders based on the generative adversarial neural network (GAN) has shown obvious advantages of generating raw waveform conditioned on mel-spectrogram with fast inference speed and lightweight networks.…

声音 · 计算机科学 2023-05-30 Kun Song , Yongmao Zhang , Yi Lei , Jian Cong , Hanzhao Li , Lei Xie , Gang He , Jinfeng Bai

In the generator of typical Generative Adversarial Networks (GANs), a noise is inputted to generate fake samples via a series of convolutional operations. However, current noise generation models merely relies on the information from the…

机器学习 · 计算机科学 2020-05-15 Shaoning Zeng , Bob Zhang

Recent studies have shown that neural vocoders based on generative adversarial network (GAN) can generate audios with high quality. While GAN based neural vocoders have shown to be computationally much more efficient than those based on…

声音 · 计算机科学 2021-06-28 Zhengxi Liu , Yanmin Qian

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

声音 · 计算机科学 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

音频与语音处理 · 电气工程与系统科学 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generating images that are…

声音 · 计算机科学 2019-02-12 Chris Donahue , Julian McAuley , Miller Puckette

Voice conversion is to generate a new speech with the source content and a target voice style. In this paper, we focus on one general setting, i.e., non-parallel many-to-many voice conversion, which is close to the real-world scenario. As…

声音 · 计算机科学 2022-07-28 Jian Ma , Zhedong Zheng , Hao Fei , Feng Zheng , Tat-seng Chua , Yi Yang

We present a novel high-fidelity real-time neural vocoder called VocGAN. A recently developed GAN-based vocoder, MelGAN, produces speech waveforms in real-time. However, it often produces a waveform that is insufficient in quality or…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Jinhyeok Yang , Junmo Lee , Youngik Kim , Hoonyoung Cho , Injung Kim

Recent approaches in text-to-speech (TTS) synthesis employ neural network strategies to vocode perceptually-informed spectrogram representations directly into listenable waveforms. Such vocoding procedures create a computational bottleneck…

声音 · 计算机科学 2019-07-29 Paarth Neekhara , Chris Donahue , Miller Puckette , Shlomo Dubnov , Julian McAuley

In this paper, we introduce MFCCGAN as a novel speech synthesizer based on adversarial learning that adopts MFCCs as input and generates raw speech waveforms. Benefiting the GAN model capabilities, it produces speech with higher…

声音 · 计算机科学 2023-10-26 Mohammad Reza Hasanabadi Majid Behdad Davood Gharavian

We investigate the effectiveness of generative adversarial networks (GANs) for speech enhancement, in the context of improving noise robustness of automatic speech recognition (ASR) systems. Prior work demonstrates that GANs can effectively…

声音 · 计算机科学 2018-11-01 Chris Donahue , Bo Li , Rohit Prabhavalkar

This paper proposes a method for generating speech from filterbank mel frequency cepstral coefficients (MFCC), which are widely used in speech applications, such as ASR, but are generally considered unusable for speech synthesis. First, we…

音频与语音处理 · 电气工程与系统科学 2018-04-04 Lauri Juvela , Bajibabu Bollepalli , Xin Wang , Hirokazu Kameoka , Manu Airaksinen , Junichi Yamagishi , Paavo Alku

Adversarial waveform generation has been a popular approach as the backend of singing voice conversion (SVC) to generate high-quality singing audio. However, the instability of GAN also leads to other problems, such as pitch jitters and U/V…

声音 · 计算机科学 2022-01-26 Haohan Guo , Zhiping Zhou , Fanbo Meng , Kai Liu

GAN vocoders are currently one of the state-of-the-art methods for building high-quality neural waveform generative models. However, most of their architectures require dozens of billion floating-point operations per second (GFLOPS) to…

音频与语音处理 · 电气工程与系统科学 2023-03-03 Ahmed Mustafa , Jean-Marc Valin , Jan Büthe , Paris Smaragdis , Mike Goodwin

Time-frequency (TF) representations provide powerful and intuitive features for the analysis of time series such as audio. But still, generative modeling of audio in the TF domain is a subtle matter. Consequently, neural audio synthesis…

声音 · 计算机科学 2019-05-17 Andrés Marafioti , Nicki Holighaus , Nathanaël Perraudin , Piotr Majdak

While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording environments and…

声音 · 计算机科学 2025-01-09 Chien-Chun Wang , Li-Wei Chen , Cheng-Kang Chou , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

In this paper, we compare different audio signal representations, including the raw audio waveform and a variety of time-frequency representations, for the task of audio synthesis with Generative Adversarial Networks (GANs). We conduct the…

音频与语音处理 · 电气工程与系统科学 2020-06-18 Javier Nistal , Stefan Lattner , Gaël Richard

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

计算与语言 · 计算机科学 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal…

声音 · 计算机科学 2024-03-26 Takashi Shibuya , Yuhta Takida , Yuki Mitsufuji

Recent advances in neural network -based text-to-speech have reached human level naturalness in synthetic speech. The present sequence-to-sequence models can directly map text to mel-spectrogram acoustic features, which are convenient for…

音频与语音处理 · 电气工程与系统科学 2019-06-27 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku