English
Related papers

Related papers: HiFi-SR: A Unified Generative Transformer-Convolut…

200 papers

Speech super-resolution (SR) reconstructs high-fidelity wideband speech from low-resolution inputs-a task that necessitates reconciling global harmonic coherence with local transient sharpness. While diffusion-based generative models yield…

Sound · Computer Science 2026-01-01 Jiajun Yuan , Xiaochen Wang , Yuhang Xiao , Yulin Wu , Chenhao Hu , Xueyang Lv

Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework by continually improving the architectural components and training strategies associated with convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Fayaz Ali Dharejo , Muhammad Zawish , Farah Deeba Yuanchun Zhou , Kapal Dev , Sunder Ali Khowaja , Nawab Muhammad Faseeh Qureshi

Single image super-resolution (SISR) has played an important role in the field of image processing. Recent generative adversarial networks (GANs) can achieve excellent results on low-resolution images. However, there are little literatures…

Image and Video Processing · Electrical Eng. & Systems 2026-01-14 Ziang Wu , Xuanyu Zhang , Yinbo Yu , Qi Zhu , Jerry Chun-Wei Lin , Chunwei Tian

Generative Adversarial Networks (GANs) currently achieve the state-of-the-art sound synthesis quality for pitched musical instruments using a 2-channel spectrogram representation consisting of log magnitude and instantaneous frequency (the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-24 Chitralekha Gupta , Purnima Kamath , Lonce Wyse

In this paper, we compare different audio signal representations, including the raw audio waveform and a variety of time-frequency representations, for the task of audio synthesis with Generative Adversarial Networks (GANs). We conduct the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Javier Nistal , Stefan Lattner , Gaël Richard

We propose a unified signal compression framework that uses a generative adversarial network (GAN) to compress heterogeneous signals. The compressed signal is represented as a latent vector and fed into a generator network that is trained…

Signal Processing · Electrical Eng. & Systems 2021-09-24 Bowen Liu , Changwoo Lee , Ang Cao , Hun-Seok Kim

Facial image super-resolution (SR) is an important preprocessing for facial image analysis, face recognition, and image-based 3D face reconstruction. Recent convolutional neural network (CNN) based method has shown excellent performance by…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Jung Un Yun , In Kyu Park

Compared with the conventional 1*1 acquisition mode of projection in computed tomography (CT) image reconstruction, the 2*2 acquisition mode improves the collection efficiency of the projection and reduces the X-ray exposure time. However,…

Medical Physics · Physics 2020-08-10 Chao Tang , Wenkun Zhang , Linyuan Wang , Ailong Cai , Ningning Liang , Lei Li , Bin Yan

We propose a unified compression framework that uses generative adversarial networks (GAN) to compress image and speech signals. The compressed signal is represented by a latent vector fed into a generator network which is trained to…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Bowen Liu , Ang Cao , Hun-seok Kim

Current speech enhancement techniques operate on the spectral domain and/or exploit some higher-level feature. The majority of them tackle a limited number of noise conditions and rely on first-order statistics. To circumvent these issues,…

Machine Learning · Computer Science 2017-06-12 Santiago Pascual , Antonio Bonafonte , Joan Serrà

Video super-resolution (VSR) has become one of the most critical problems in video processing. In the deep learning literature, recent works have shown the benefits of using adversarial-based and perceptual losses to improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Alice Lucas , Santiago Lopez Tapia , Rafael Molina , Aggelos K. Katsaggelos

Image super-resolution aims to synthesize high-resolution image from a low-resolution image. It is an active area to overcome the resolution limitations in several applications like low-resolution object-recognition, medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Neeraj Baghel , Shiv Ram Dubey , Satish Kumar Singh

There have been several successful deep learning models that perform audio super-resolution. Many of these approaches involve using preprocessed feature extraction which requires a lot of domain-specific signal processing knowledge to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-01 James King , Ramon Viñas Torné , Alexander Campbell , Pietro Liò

Time-frequency (TF) representations provide powerful and intuitive features for the analysis of time series such as audio. But still, generative modeling of audio in the TF domain is a subtle matter. Consequently, neural audio synthesis…

Sound · Computer Science 2019-05-17 Andrés Marafioti , Nicki Holighaus , Nathanaël Perraudin , Piotr Majdak

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

We investigate the use of generative adversarial networks (GANs) in speech dereverberation for robust speech recognition. GANs have been recently studied for speech enhancement to remove additive noises, but there still lacks of a work to…

Sound · Computer Science 2019-01-01 Ke Wang , Junbo Zhang , Sining Sun , Yujun Wang , Fei Xiang , Lei Xie

We propose a new framework to improve automatic speech recognition (ASR) systems in resource-scarce environments using a generative adversarial network (GAN) operating on acoustic input features. The GAN is used to enhance the features of…

Sound · Computer Science 2022-10-07 Walter Heymans , Marelie H. Davel , Charl van Heerden

Speech enhancement aims to obtain speech signals with high intelligibility and quality from noisy speech. Recent work has demonstrated the excellent performance of time-domain deep learning methods, such as Conv-TasNet. However, these…

Sound · Computer Science 2021-09-21 Feiyang Xiao , Jian Guan , Qiuqiang Kong , Wenwu Wang

The performance of speech processing models trained on clean speech drops significantly in noisy conditions. Training with noisy datasets alleviates the problem, but procuring such datasets is not always feasible. Noisy speech simulation…

Sound · Computer Science 2023-05-23 Leander Melroy Maben , Zixun Guo , Chen Chen , Utkarsh Chudiwal , Chng Eng Siong

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin