English
Related papers

Related papers: NU-GAN: High resolution neural upsampling with GAN

200 papers

Recently, realistic data augmentation using neural networks especially generative neural networks (GAN) has achieved outstanding results. The communities main research focus is visual image processing. However, automotive cars and robots…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Maximilian Pöpperl , Raghavendra Gulagundi , Senthil Yogamani , Stefan Milz

Popular neural network-based speech enhancement systems operate on the magnitude spectrogram and ignore the phase mismatch between the noisy and clean speech signals. Conditional generative adversarial networks (cGANs) show promise in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Deepak Baby

This paper proposes a source-filter-based generative adversarial neural vocoder named SF-GAN, which achieves high-fidelity waveform generation from input acoustic features by introducing F0-based source excitation signals to a neural filter…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

Whistle contour extraction aims to derive animal whistles from time-frequency spectrograms as polylines. For toothed whales, whistle extraction results can serve as the basis for analyzing animal abundance, species identity, and social…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Pu Li , Marie Roch , Holger Klinck , Erica Fleishman , Douglas Gillespie , Eva-Marie Nosal , Yu Shiu , Xiaobai Liu

Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-stage enhancement…

Machine Learning · Computer Science 2020-10-28 Huy Phan , Ian V. McLoughlin , Lam Pham , Oliver Y. Chén , Philipp Koch , Maarten De Vos , Alfred Mertins

Enhancing speech signal quality in adverse acoustic environments is a persistent challenge in speech processing. Existing deep learning based enhancement methods often struggle to effectively remove background noise and reverberation in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Heming Wang , Meng Yu , Hao Zhang , Chunlei Zhang , Zhongweiyang Xu , Muqiao Yang , Yixuan Zhang , Dong Yu

This paper describes a real-time General Speech Reconstruction (Gesper) system submitted to the ICASSP 2023 Speech Signal Improvement (SSI) Challenge. This novel proposed system is a two-stage architecture, in which the speech restoration…

Sound · Computer Science 2023-06-16 Wenzhe Liu , Yupeng Shi , Jun Chen , Wei Rao , Shulin He , Andong Li , Yannan Wang , Zhiyong Wu

Back translation, as a technique for extending a dataset, is widely used by researchers in low-resource language translation tasks. It typically translates from the target to the source language to ensure high-quality translation results.…

Computation and Language · Computer Science 2024-08-23 Hengjie Liu , Ruibo Hou , Yves Lepage

In this paper, we present Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial network (GAN) that enhances audio measured with body-conduction microphones. This type of capture equipment suppresses ambient noise at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-18 Julien Hauret , Thomas Joubaud , Véronique Zimpfer , Éric Bavu

Audio super-resolution is a challenging task of recovering the missing high-resolution features from a low-resolution signal. To address this, generative adversarial networks (GAN) have been used to achieve promising results by training the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Shichao Hu , Bin Zhang , Beici Liang , Ethan Zhao , Simon Lui

We propose a novel method of efficient upsampling of a single natural image. Current methods for image upsampling tend to produce high-resolution images with either blurry salient edges, or loss of fine textural detail, or spurious noise…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Chinmay Hegde , Oncel Tuzel , Fatih Porikli

Voice Conversion (VC) emerged as a significant domain of research in the field of speech synthesis in recent years due to its emerging application in voice-assisting technology, automated movie dubbing, and speech-to-singing conversion to…

Sound · Computer Science 2021-04-27 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

In this paper, we propose a novel variational generator framework for conditional GANs to catch semantic details for improving the generation quality and diversity. Traditional generators in conditional GANs simply concatenate the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Mingqi Hu , Deyu Zhou , Yulan He

Image super-resolution is one of the important computer vision techniques aiming to reconstruct high-resolution images from corresponding low-resolution ones. Most recently, deep learning-based approaches have been demonstrated for image…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Jie Cai , Zibo Meng , Chiu Man Ho

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal…

Sound · Computer Science 2024-03-26 Takashi Shibuya , Yuhta Takida , Yuki Mitsufuji

Through the probing of light-matter interactions, Raman spectroscopy provides invaluable insights into the composition, structure, and dynamics of materials, and obtaining such data from portable and cheap instruments is of immense…

Chemical Physics · Physics 2024-07-03 Vikas Yadav , Abhay Kumar Tiwari , Soumik Siddhanta

The classification of acoustic environments allows for machines to better understand the auditory world around them. The use of deep learning in order to teach machines to discriminate between different rooms is a new area of research.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-07 Constantinos Papayiannis , Christine Evers , Patrick A. Naylor

Speech enhancement remains challenging due to the trade-off between efficiency and perceptual quality. In this paper, we introduce MAGE, a Masked Audio Generative Enhancer that advances generative speech enhancement through a compact and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 The Hieu Pham , Tan Dat Nguyen , Phuong Thanh Tran , Joon Son Chung , Duc Dung Nguyen

Radio surveys are widely used to study active galactic nuclei. Radio interferometric observations typically trade-off surface brightness sensitivity for angular resolution. Hence, observations using a wide range of baseline lengths are…

Astrophysics of Galaxies · Physics 2019-06-11 Nina Glaser , O Ivy Wong , Kevin Schawinski , Ce Zhang