English
Related papers

Related papers: Multi-SpectroGAN: High-Diversity and High-Fidelity…

200 papers

As more and more data is collected in various settings across organizations, companies, and countries, there has been an increase in the demand of user privacy. Developing privacy preserving methods for data analytics is thus an important…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 David Ericsson , Adam Östberg , Edvin Listo Zec , John Martinsson , Olof Mogren

Generative Adversarial Networks (GANs) currently achieve the state-of-the-art sound synthesis quality for pitched musical instruments using a 2-channel spectrogram representation consisting of log magnitude and instantaneous frequency (the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-24 Chitralekha Gupta , Purnima Kamath , Lonce Wyse

The performance of speech processing models trained on clean speech drops significantly in noisy conditions. Training with noisy datasets alleviates the problem, but procuring such datasets is not always feasible. Noisy speech simulation…

Sound · Computer Science 2023-05-23 Leander Melroy Maben , Zixun Guo , Chen Chen , Utkarsh Chudiwal , Chng Eng Siong

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

Computation and Language · Computer Science 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

Speech enhancement aims to obtain speech signals with high intelligibility and quality from noisy speech. Recent work has demonstrated the excellent performance of time-domain deep learning methods, such as Conv-TasNet. However, these…

Sound · Computer Science 2021-09-21 Feiyang Xiao , Jian Guan , Qiuqiang Kong , Wenwu Wang

In this paper, we propose multi-band MelGAN, a much faster waveform generation model targeting to high-quality text-to-speech. Specifically, we improve the original MelGAN by the following aspects. First, we increase the receptive field of…

Sound · Computer Science 2020-11-18 Geng Yang , Shan Yang , Kai Liu , Peng Fang , Wei Chen , Lei Xie

We propose Universal MelGAN, a vocoder that synthesizes high-fidelity speech in multiple domains. To preserve sound quality when the MelGAN-based structure is trained with a dataset of hundreds of speakers, we added multi-resolution…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Won Jang , Dan Lim , Jaesam Yoon

Entertainment-oriented singing voice synthesis (SVS) requires a vocoder to generate high-fidelity (e.g. 48kHz) audio. However, most text-to-speech (TTS) vocoders cannot reconstruct the waveform well in this scenario. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Chunhui Wang , Chang Zeng , Jun Chen , Xing He

This paper proposes a source-filter-based generative adversarial neural vocoder named SF-GAN, which achieves high-fidelity waveform generation from input acoustic features by introducing F0-based source excitation signals to a neural filter…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

Generating qualitative responses has always been a challenge for human-computer dialogue systems. Existing dialogue systems generally derive from either retrieval-based or generative-based approaches, both of which have their own pros and…

Computation and Language · Computer Science 2020-05-01 Jiayi Zhang , Chongyang Tao , Zhenjing Xu , Qiaojing Xie , Wei Chen , Rui Yan

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

Machine Learning · Computer Science 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang

With rapid progress in neural text-to-speech (TTS) models, personalized speech generation is now in high demand for many applications. For practical applicability, a TTS model should generate high-quality speech with only a few audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Dongchan Min , Dong Bok Lee , Eunho Yang , Sung Ju Hwang

In recent years generative adversarial network (GAN) based models have been successfully applied for unsupervised speech-to-speech conversion.The rich compact harmonic view of the magnitude spectrogram is considered a suitable choice for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Mohammad Asif Khan , Fabien Cardinaux , Stefan Uhlich , Marc Ferras , Asja Fischer

Text-to-Speech (TTS) models can generate natural, human-like speech across multiple languages by transforming phonemes into waveforms. However, multilingual TTS remains challenging due to discrepancies in phoneme vocabularies and variations…

Sound · Computer Science 2025-04-14 Haowei Lou , Hye-young Paik , Sheng Li , Wen Hu , Lina Yao

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yang Zhou , Zhiwen Yang , Hui Zhang , Eric I-Chao Chang , Yubo Fan , Yan Xu

Despite advances in deep learning, current state-of-the-art speech emotion recognition (SER) systems still have poor performance due to a lack of speech emotion datasets. This paper proposes augmenting SER systems with synthetic emotional…

Sound · Computer Science 2023-01-11 Abdullah Shahid , Siddique Latif , Junaid Qadir

Several recent end-to-end text-to-speech (TTS) models enabling single-stage training and parallel sampling have been proposed, but their sample quality does not match that of two-stage TTS systems. In this work, we present a parallel…

Sound · Computer Science 2021-06-14 Jaehyeon Kim , Jungil Kong , Juhee Son