English
Related papers

Related papers: mdctGAN: Taming transformer-based GAN for speech s…

200 papers

Dysarthric speech reconstruction (DSR) aims to convert dysarthric speech into comprehensible speech while maintaining the speaker's identity. Despite significant advancements, existing methods often struggle with low speech intelligibility…

Sound · Computer Science 2025-06-03 Xueyuan Chen , Dongchao Yang , Wenxuan Wu , Minglin Wu , Jing Xu , Xixin Wu , Zhiyong Wu , Helen Meng

Most of the current deep learning-based approaches for speech enhancement only operate in the spectrogram or waveform domain. Although a cross-domain transformer combining waveform- and spectrogram-domain inputs has been proposed, its…

Sound · Computer Science 2023-10-31 Jialu Li , Junhui Li , Pu Wang , Youshan Zhang

Over the past decade, many Super Resolution techniques have been developed using deep learning. Among those, generative adversarial networks (GAN) and very deep convolutional networks (VDSR) have shown promising results in terms of HR image…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Saifuddin Hitawala , Yao Li , Xian Wang , Dongyang Yang

With the rapid development of neural networks in recent years, the ability of various networks to enhance the magnitude spectrum of noisy speech in the single-channel speech enhancement domain has become exceptionally outstanding. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Shiqi Zhang , Zheng Qiu , Daiki Takeuchi , Noboru Harada , Shoji Makino

Digital Rock Imaging is constrained by detector hardware, and a trade-off between the image field of view (FOV) and the image resolution must be made. This can be compensated for with super resolution (SR) techniques that take a wide FOV,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-18 Ying Da Wang , Ryan T. Armstrong , Peyman Mostaghimi

Most GAN(Generative Adversarial Network)-based approaches towards high-fidelity waveform generation heavily rely on discriminators to improve their performance. However, GAN methods introduce much uncertainty into the generation process and…

Sound · Computer Science 2022-03-22 Shengyuan Xu , Wenxiao Zhao , Jing Guo

Deep learning methods, in particular trained Convolutional Neural Networks (CNNs) have recently been shown to produce compelling state-of-the-art results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the low…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Tiantong Guo , Hojjat S. Mousavi , Vishal Monga

Previous speech restoration (SR) primarily focuses on single-task speech restoration (SSR), which cannot address general speech restoration problems. Training specific SSR models for different distortions is time-consuming and lacks…

Sound · Computer Science 2026-02-16 Ziqi Liang , Zhijun Jia , Chang Liu , Minghui Yang , Zhihong Lu , Jian Wang

MRI super-resolution (SR) and denoising tasks are fundamental challenges in the field of deep learning, which have traditionally been treated as distinct tasks with separate paired training data. In this paper, we propose an innovative…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Qi Wang , Lucas Mahler , Julius Steiglechner , Florian Birk , Klaus Scheffler , Gabriele Lohmann

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

In recent years, Speech Emotion Recognition (SER) has been investigated mainly transforming the speech signal into spectrograms that are then classified using Convolutional Neural Networks pretrained on generic images and fine tuned with…

Sound · Computer Science 2022-11-07 A. Arezzo , S. Berretti

This paper aims to enhance low-resource TTS by reducing training data requirements using compact speech representations. A Multi-Stage Multi-Codebook (MSMC) VQ-GAN is trained to learn the representation, MSMCR, and decode it to waveforms.…

Sound · Computer Science 2022-10-28 Haohan Guo , Fenglong Xie , Xixin Wu , Hui Lu , Helen Meng

Nowadays vast amounts of speech data are recorded from low-quality recorder devices such as smartphones, tablets, laptops, and medium-quality microphones. The objective of this research was to study the automatic generation of high-quality…

Generative Adversarial Network (GAN) based vocoders are superior in both inference speed and synthesis quality when reconstructing an audible waveform from an acoustic representation. This study focuses on improving the discriminator for…

Sound · Computer Science 2024-04-29 Yicheng Gu , Xueyao Zhang , Liumeng Xue , Haizhou Li , Zhizheng Wu

We propose a neural audio generative model, MDCTNet, operating in the perceptually weighted domain of an adaptive modified discrete cosine transform (MDCT). The architecture of the model captures correlations in both time and frequency…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Grant Davidson , Mark Vinton , Per Ekstrand , Cong Zhou , Lars Villemoes , Lie Lu

The success of adversarial attacks to speaker recognition is mainly in white-box scenarios. When applying the adversarial voices that are generated by attacking white-box surrogate models to black-box victim models, i.e.…

Sound · Computer Science 2023-02-22 Jiadi Yao , Hong Luo , Xiao-Lei Zhang

Spectral subtraction, widely used for its simplicity, has been employed to address the Robot Ego Speech Filtering (RESF) problem for detecting speech contents of human interruption from robot's single-channel microphone recordings when it…

Robotics · Computer Science 2024-09-11 Yue Li , Koen V. Hindriks , Florian A. Kunneman

Deep generative models have achieved significant progress in speech synthesis to date, while high-fidelity singing voice synthesis is still an open problem for its long continuous pronunciation, rich high-frequency parts, and strong…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-08 Rongjie Huang , Chenye Cui , Feiyang Chen , Yi Ren , Jinglin Liu , Zhou Zhao , Baoxing Huai , Zhefeng Wang

Recently, diffusion models (DMs) have been increasingly used in audio processing tasks, including speech super-resolution (SR), which aims to restore high-frequency content given low-resolution speech utterances. This is commonly achieved…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Sung-Lin Yeh , György Fazekas , Hao Tang

In general, the performance of automatic speech recognition (ASR) systems is significantly degraded due to the mismatch between training and test environments. Recently, a deep-learning-based image-to-image translation technique to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-15 Jong-Hyeon Park , Myungwoo Oh , Hyung-Min Park