English
Related papers

Related papers: Towards Controllable Audio Texture Morphing

200 papers

We propose to improve unconditional Generative Adversarial Networks (GAN) by training the self-supervised learning with the adversarial process. In particular, we apply self-supervised learning via the geometric transformation on input…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Ngai-Man Cheung

Generative Adversarial Networks (GANs) are susceptible to bias, learned from either the unbalanced data, or through mode collapse. The networks focus on the core of the data distribution, leaving the tails - or the edges of the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Yunzhe Liu , Rinon Gal , Amit H. Bermano , Baoquan Chen , Daniel Cohen-Or

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Popular neural network-based speech enhancement systems operate on the magnitude spectrogram and ignore the phase mismatch between the noisy and clean speech signals. Conditional generative adversarial networks (cGANs) show promise in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Deepak Baby

A generative adversarial network (GAN) has been a representative backbone model in generative artificial intelligence (AI) because of its powerful performance in capturing intricate data-generating processes. However, the GAN training is…

Machine Learning · Statistics 2025-08-21 Jinwon Sohn , Qifan Song

In this paper, we present a deep-learning method to filter out effects such as ambient noise, reflections, or source directivity from microphone array data represented as cross-spectral matrices. Specifically, we focus on a generative…

Sound · Computer Science 2025-03-03 Christof Puhle

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

Generative adversarial networks (GANs) are a framework that learns a generative distribution through adversarial training. Recently, their class-conditional extensions (e.g., conditional GAN (cGAN) and auxiliary classifier GAN (AC-GAN))…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Neural network-based methods have recently demonstrated state-of-the-art results on image synthesis and super-resolution tasks, in particular by using variants of generative adversarial networks (GANs) with supervised feature losses.…

Sound · Computer Science 2019-03-22 Sung Kim , Visvesh Sathe

We investigate data-driven texture modeling via analysis and synthesis with generative adversarial networks. For network training and testing, we have compiled a diverse set of spatially homogeneous textures, ranging from stochastic to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Jue Lin , Gaurav Sharma , Thrasyvoulos N. Pappas

Text generation with generative adversarial networks (GANs) can be divided into the text-based and code-based categories according to the type of signals used for discrimination. In this work, we introduce a novel text-based approach called…

Computation and Language · Computer Science 2019-04-24 Md. Akmal Haidar , Mehdi Rezagholizadeh , Alan Do-Omri , Ahmad Rashid

Generative adversarial networks (GANs) have achieved remarkable progress in recent years, but the continuously growing scale of models makes them challenging to deploy widely in practical applications. In particular, for real-time…

Machine Learning · Computer Science 2021-03-19 Liang Hou , Zehuan Yuan , Lei Huang , Huawei Shen , Xueqi Cheng , Changhu Wang

Previous works (Donahue et al., 2018a; Engel et al., 2019a) have found that generating coherent raw audio waveforms with GANs is challenging. In this paper, we show that it is possible to train GANs reliably to generate high quality…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-10 Kundan Kumar , Rithesh Kumar , Thibault de Boissiere , Lucas Gestin , Wei Zhen Teoh , Jose Sotelo , Alexandre de Brebisson , Yoshua Bengio , Aaron Courville

We propose AudioStyleGAN (ASGAN), a new generative adversarial network (GAN) for unconditional speech synthesis. As in the StyleGAN family of image synthesis models, ASGAN maps sampled noise to a disentangled latent vector which is then…

Sound · Computer Science 2022-10-12 Matthew Baas , Herman Kamper

Generative Adversarial Networks (GANs) have gained a lot of attention from machine learning community due to their ability to learn and mimic an input data distribution. GANs consist of a discriminator and a generator working in tandem…

Computation and Language · Computer Science 2018-06-19 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Audio captioning aims at generating natural language descriptions for audio clips automatically. Existing audio captioning models have shown promising improvement in recent years. However, these models are mostly trained via maximum…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Xinhao Mei , Xubo Liu , Jianyuan Sun , Mark D. Plumbley , Wenwu Wang

This paper presents a deep learning-based approach for the spatio-temporal reconstruction of sound fields using Generative Adversarial Networks (GANs). The method utilises a plane wave basis and learns the underlying statistical…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-02 Xenofon Karakonstantis , Efren Fernandez-Grande

Recently introduced generative adversarial network (GAN) has been shown numerous promising results to generate realistic samples. The essential task of GAN is to control the features of samples generated from a random distribution. While…

Machine Learning · Computer Science 2019-04-02 Minhyeok Lee , Junhee Seok

Multi-domain image-to-image translation with conditional Generative Adversarial Networks (GANs) can generate highly photo realistic images with desired target classes, yet these synthetic images have not always been helpful to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Suman Sapkota , Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Tae-Kyun Kim

In recent years, image generation has shown a great leap in performance, where diffusion models play a central role. Although generating high-quality images, such models are mainly conditioned on textual descriptions. This begs the…

Sound · Computer Science 2023-05-23 Guy Yariv , Itai Gat , Lior Wolf , Yossi Adi , Idan Schwartz