English
Related papers

Related papers: GANSynth: Adversarial Neural Audio Synthesis

200 papers

While generative adversarial networks (GANs) have been widely used in research on audio generation, the training of a GAN model is known to be unstable, time consuming, and data inefficient. Among the attempts to ameliorate the training…

Sound · Computer Science 2022-09-07 Yen-Tung Yeh , Bo-Yu Chen , Yi-Hsuan Yang

Generative Adversarial Networks (GANs) are machine learning networks based around creating synthetic data. Voice Conversion (VC) is a subset of voice translation that involves translating the paralinguistic features of a source speaker to a…

Sound · Computer Science 2021-02-24 Samuel J. Broughton , Md Asif Jalal , Roger K. Moore

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

As a revolutionary generative paradigm of deep learning, generative adversarial networks (GANs) have been widely applied in various fields to synthesize realistic data. However, it is challenging for conventional GANs to synthesize raw…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Weidong Wang , Jiancheng An , Hongshu Liao , Lu Gan , Chau Yuen

Generative models have thrived in computer vision, enabling unprecedented image processes. Yet the results in audio remain less advanced. Our project targets real-time sound synthesis from a reduced set of high-level parameters, including…

Sound · Computer Science 2019-06-25 Adrien Bitton , Philippe Esling , Antoine Caillon , Martin Fouilleul

Conditional waveform synthesis models learn a distribution of audio waveforms given conditioning such as text, mel-spectrograms, or MIDI. These systems employ deep generative models that model the waveform via either sequential…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-07 Max Morrison , Rithesh Kumar , Kundan Kumar , Prem Seetharaman , Aaron Courville , Yoshua Bengio

Within Music Information Retrieval (MIR), prominent tasks -- including pitch-tracking, source-separation, super-resolution, and synthesis -- typically call for specialised methods, despite their similarities. Conditional Generative…

Sound · Computer Science 2019-03-04 Steven Spratley , Daniel Beck , Trevor Cohn

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Generative Adversarial Networks (GANs) have been promising in the field of image generation, however, they have been hard to train for language generation. GANs were originally designed to output differentiable values, so discrete language…

Machine Learning · Computer Science 2018-07-04 Mehrad Moradshahi , Utkarsh Contractor

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

Deep learning has become a standard approach for the modeling of audio effects, yet strictly black-box modeling remains problematic for time-varying systems. Unlike time-invariant effects, training models on devices with internal modulation…

Sound · Computer Science 2025-12-18 Yann Bourdin , Pierrick Legrand , Fanny Roche

Generative adversarial networks (GANs) has gained tremendous popularity lately due to an ability to reinforce quality of its predictive model with generated objects and the quality of the generative model with and supervised feedback. GANs…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Evgeny Zamyatin , Andrey Filchenkov

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

Machine Learning · Computer Science 2023-04-06 Divya Saxena , Jiannong Cao

Generative Adversarial Networks (GANs) have shown immense potential in fields such as text and image generation. Only very recently attempts to exploit GANs to statistical-mechanics models have been reported. Here we quantitatively test…

Statistical Mechanics · Physics 2024-05-07 Daniele Lanzoni , Olivier Pierre-Louis , Francesco Montalenti

The problem of audio synthesis has been increasingly solved using deep neural networks. With the introduction of Generative Adversarial Networks (GAN), another efficient and adjective path has opened up to solve this problem. In this paper,…

Sound · Computer Science 2021-02-23 Shreeviknesh Sankaran , Sukavanan Nanjundan , G. Paavai Anand

Can we develop a model that can synthesize realistic speech directly from a latent space, without explicit conditioning? Despite several efforts over the last decade, previous adversarial and diffusion-based approaches still struggle to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-26 Matthew Baas , Herman Kamper

We introduce a new system for data-driven audio sound model design built around two different neural network architectures, a Generative Adversarial Network(GAN) and a Recurrent Neural Network (RNN), that takes advantage of the unique…

Sound · Computer Science 2022-06-28 Lonce Wyse , Purnima Kamath , Chitralekha Gupta

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Antonia Creswell , Anil A Bharath