English
Related papers

Related papers: Basis-MelGAN: Efficient Neural Vocoder Based on Au…

200 papers

In recent years, the use of Generative Adversarial Networks (GANs) has become very popular in generative image modeling. While style-based GAN architectures yield state-of-the-art results in high-fidelity image synthesis, computationally,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Sergei Belousov

We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discriminator that is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Sebastian Lutz , Konstantinos Amplianitis , Aljosa Smolic

Deep neural networks have been applied in wireless communications system to intelligently adapt to dynamically changing channel conditions, while the users are still under the threat of the malicious attacks due to the broadcasting property…

Information Theory · Computer Science 2025-05-02 Jianyuan Chen , Lin Zhang , Zuwei Chen , Yawen Chen , Hongcheng Zhuang

We introduce a new system for data-driven audio sound model design built around two different neural network architectures, a Generative Adversarial Network(GAN) and a Recurrent Neural Network (RNN), that takes advantage of the unique…

Sound · Computer Science 2022-06-28 Lonce Wyse , Purnima Kamath , Chitralekha Gupta

State-of-the-art models for high-resolution image generation, such as BigGAN and VQVAE-2, require an incredible amount of compute resources and/or time (512 TPU-v3 cores) to train, putting them out of reach for the larger research…

Image and Video Processing · Electrical Eng. & Systems 2020-10-27 Seungwook Han , Akash Srivastava , Cole Hurwitz , Prasanna Sattigeri , David D. Cox

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

Machine Learning · Computer Science 2023-04-06 Divya Saxena , Jiannong Cao

Existing deep learning real denoising methods require a large amount of noisy-clean image pairs for supervision. Nonetheless, capturing a real noisy-clean dataset is an unacceptable expensive and cumbersome procedure. To alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Yuanhao Cai , Xiaowan Hu , Haoqian Wang , Yulun Zhang , Hanspeter Pfister , Donglai Wei

Recently, neural vocoders have been widely used in speech synthesis tasks, including text-to-speech and voice conversion. However, when encountering data distribution mismatch between training and inference, neural vocoders trained on real…

Sound · Computer Science 2020-08-21 Po-chun Hsu , Chun-hsuan Wang , Andy T. Liu , Hung-yi Lee

This paper presents BemaGANv2, an advanced GAN-based vocoder designed for high-fidelity and long-term audio generation, with a focus on systematic evaluation of discriminator combination strategies. Long-term audio generation is critical…

Encoder-decoder GANs architectures (e.g., BiGAN and ALI) seek to add an inference mechanism to the GANs setup, consisting of a small encoder deep net that maps data-points to their succinct encodings. The intuition is that being forced to…

Machine Learning · Computer Science 2017-11-08 Sanjeev Arora , Andrej Risteski , Yi Zhang

Generative adversarial networks (GANs) are increasingly attracting attention in the computer vision, natural language processing, speech synthesis and similar domains. However, evaluating the performance of GANs is still an open and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Zhengwei Wang , Qi She , Alan F. Smeaton , Tomas E. Ward , Graham Healy

Deep Learning has gained immense success in pushing today's artificial intelligence forward. To solve the challenge of limited labeled data in the supervised learning world, unsupervised learning has been proposed years ago while low…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 F. Liu , C. Liu , F. Bi

Generative adversarial networks (GANs) are one of the most widely used generative models. GANs can learn complex multi-modal distributions, and generate real-like samples. Despite the major success of GANs in generating synthetic data, they…

Machine Learning · Computer Science 2021-09-07 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

Generating a pose-invariant representation capable of synthesizing multiple face pose views from a single pose is still a difficult problem. The solution is demanded in various areas like multimedia security, computer vision, robotics, etc.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Hamed Alqahtani

Generative adversarial networks (GANs) have shown excellent performance in image and speech applications. GANs create impressive data primarily through a new type of operator called deconvolution (DeConv) or transposed convolution (Conv).…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-19 Jung-Woo Chang , Saehyun Ahn , Keon-Woo Kang , Suk-Ju Kang

Recent advances in visually-induced audio generation are based on sampling short, low-fidelity, and one-class sounds. Moreover, sampling 1 second of audio from the state-of-the-art model takes minutes on a high-end GPU. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Vladimir Iashin , Esa Rahtu

Recently, convolution-augmented transformer (Conformer) has achieved promising performance in automatic speech recognition (ASR) and time-domain speech enhancement (SE), as it can capture both local and global dependencies in the speech…

Sound · Computer Science 2024-05-07 Ruizhe Cao , Sherif Abdulatif , Bin Yang

Recently, deep learning-based generative models have been introduced to generate singing voices. One approach is to predict the parametric vocoder features consisting of explicit speech parameters. This approach has the advantage that the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Tae-Woo Kim , Min-Su Kang , Gyeong-Hoon Lee

In this paper, we present a deep-learning method to filter out effects such as ambient noise, reflections, or source directivity from microphone array data represented as cross-spectral matrices. Specifically, we focus on a generative…

Sound · Computer Science 2025-03-03 Christof Puhle

Generative adversarial networks (GANs) have shown remarkable success in generating realistic data from some predefined prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus…

Machine Learning · Computer Science 2020-08-04 Jiezhang Cao , Yong Guo , Qingyao Wu , Chunhua Shen , Junzhou Huang , Mingkui Tan