English
Related papers

Related papers: A Benchmarking Initiative for Audio-Domain Music G…

200 papers

The use of deep learning to solve problems in literary arts has been a recent trend that has gained a lot of attention and automated generation of music has been an active area. This project deals with the generation of music using raw…

Sound · Computer Science 2016-12-16 Vasanth Kalingeri , Srikanth Grandhe

With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio…

Sound · Computer Science 2024-06-13 Zeyu Xie , Baihan Li , Xuenan Xu , Zheng Liang , Kai Yu , Mengyue Wu

Automatic Music Generation (AMG) has become an interesting research topic for many scientists in artificial intelligence, who are also interested in the music industry. One of the main challenges in AMG is that there is no clear objective…

Artificial Intelligence · Computer Science 2022-06-06 Maryam Majidi , Rahil Mahdian Toroghi

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

In recent years, machine learning, and in particular generative adversarial neural networks (GANs) and attention-based neural networks (transformers), have been successfully used to compose and generate music, both melodies and polyphonic…

In this paper, we propose and investigate the use of neural audio codec language models for the automatic generation of sample-based musical instruments based on text or reference audio prompts. Our approach extends a generative audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-23 Shahan Nercessian , Johannes Imort , Ninon Devis , Frederik Blang

We introduce a new system for data-driven audio sound model design built around two different neural network architectures, a Generative Adversarial Network(GAN) and a Recurrent Neural Network (RNN), that takes advantage of the unique…

Sound · Computer Science 2022-06-28 Lonce Wyse , Purnima Kamath , Chitralekha Gupta

End-to-end generation of musical audio using deep learning techniques has seen an explosion of activity recently. However, most models concentrate on generating fully mixed music in response to abstract conditioning information. In this…

The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a…

Sound · Computer Science 2020-06-16 Andong Li , Chengshi Zheng , Renhua Peng , Cunhang Fan , Xiaodong Li

Recent advancements have brought generated music closer to human-created compositions, yet evaluating these models remains challenging. While human preference is the gold standard for assessing quality, translating these subjective…

Machine Learning · Computer Science 2025-06-25 Florian Grötschla , Ahmet Solak , Luca A. Lanzendörfer , Roger Wattenhofer

Generating qualitative responses has always been a challenge for human-computer dialogue systems. Existing dialogue systems generally derive from either retrieval-based or generative-based approaches, both of which have their own pros and…

Computation and Language · Computer Science 2020-05-01 Jiayi Zhang , Chongyang Tao , Zhenjing Xu , Qiaojing Xie , Wei Chen , Rui Yan

Generative adversarial network (GAN) models can synthesize highquality audio signals while ensuring fast sample generation. However, they are difficult to train and are prone to several issues including mode collapse and divergence. In this…

Sound · Computer Science 2024-02-06 Teysir Baoueb , Haocheng Liu , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

The rapid proliferation of AI-Generated Content (AIGC) has necessitated robust metrics for perceptual quality assessment. However, automatic Mean Opinion Score (MOS) prediction models are often compromised by data scarcity, predisposing…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Kuan-Tang Huang , Chien-Chun Wang , Cheng-Yeh Yang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

Although recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space. This difference leads to spectral artifacts such as hissing noise…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Seong-Whan Lee

Recent improvements in generative adversarial network (GAN) training techniques prove that progressively training a GAN drastically stabilizes the training and improves the quality of outputs produced. Adding layers after the previous ones…

Sound · Computer Science 2019-03-13 Manan Oza , Himanshu Vaghela , Kriti Srivastava

We present Dance2Music-GAN (D2M-GAN), a novel adversarial multi-modal framework that generates complex musical samples conditioned on dance videos. Our proposed framework takes dance video frames and human body motions as input, and learns…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ye Zhu , Kyle Olszewski , Yu Wu , Panos Achlioptas , Menglei Chai , Yan Yan , Sergey Tulyakov

Recent studies have shown that neural vocoders based on generative adversarial network (GAN) can generate audios with high quality. While GAN based neural vocoders have shown to be computationally much more efficient than those based on…

Sound · Computer Science 2021-06-28 Zhengxi Liu , Yanmin Qian

Generative adversarial networks have been proposed as a way of efficiently training deep generative neural networks. We propose a generative adversarial model that works on continuous sequential data, and apply it by training it on a…

Artificial Intelligence · Computer Science 2016-12-01 Olof Mogren

Generative audio models are rapidly advancing in both capabilities and public utilization -- several powerful generative audio models have readily available open weights, and some tech companies have released high quality generative audio…