English
Related papers

Related papers: A Benchmarking Initiative for Audio-Domain Music G…

200 papers

Creativity support tools (CSTs) typically frame search as information retrieval, yet in practices like electronic dance music production, search serves as a creative medium for collage-style composition. To address this gap, we present…

Human-Computer Interaction · Computer Science 2026-03-10 Sheng Long , Atsuya Kobayashi , Kei Tateno

In this paper, we propose a data-driven approach to train a Generative Adversarial Network (GAN) conditioned on "soft-labels" distilled from the penultimate layer of an audio classifier trained on a target set of audio texture classes. We…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Chitralekha Gupta , Purnima Kamath , Yize Wei , Zhuoyao Li , Suranga Nanayakkara , Lonce Wyse

This work addresses the challenging domain adaptation setting in which knowledge from the labelled source domain dataset is available only from the pretrained black-box segmentation model. The pretrained model's predictions for the target…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Gabriel Tjio , Ping Liu , Yawei Luo , Chee Keong Kwoh , Joey Zhou Tianyi

Recently, GAN based speech synthesis methods, such as MelGAN, have become very popular. Compared to conventional autoregressive based methods, parallel structures based generators make waveform generation process fast and stable. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Qiao Tian , Yi Chen , Zewang Zhang , Heng Lu , Linghui Chen , Lei Xie , Shan Liu

In this paper AlimNet (With respect to great musician, Alim Qasimov) an auxiliary generative adversarial deep neural network (ACGAN) for generating music categorically, is used. This proposed network is a conditional ACGAN to condition the…

Sound · Computer Science 2019-01-16 Saber Malekzadeh , Maryam Samami , Shahla RezazadehAzar , Maryam Rayegan

We propose Ambient Dataloops, an iterative framework for refining datasets that makes it easier for diffusion models to learn the underlying data distribution. Modern datasets contain samples of highly varying quality, and training directly…

Generative Adversarial Networks (GANs) represent an attractive and novel approach to generate realistic data, such as genes, proteins, or drugs, in synthetic biology. Here, we apply GANs to generate synthetic DNA sequences encoding for…

Genomics · Quantitative Biology 2018-04-06 Anvita Gupta , James Zou

Melody generation from lyrics has been a challenging research issue in the field of artificial intelligence and music, which enables to learn and discover latent relationship between interesting lyrics and accompanying melody.…

Artificial Intelligence · Computer Science 2021-04-22 Yi Yu , Abhishek Srivastava , Simon Canales

This work addresses the lack of multimodal generative models capable of producing high-quality videos with spatially aligned audio. While recent advancements in generative models have been successful in video generation, they often overlook…

Sound · Computer Science 2026-02-05 Kazuki Shimada , Christian Simon , Takashi Shibuya , Shusuke Takahashi , Yuki Mitsufuji

Reward Modeling is critical in evaluating and improving the generation of Large Language Models (LLMs). While numerous recent works have shown its feasibility in improving safety, helpfulness, reasoning, and instruction-following ability,…

Computation and Language · Computer Science 2025-11-13 Hanning Zhang , Juntong Song , Juno Zhu , Yuanhao Wu , Tong Zhang , Cheng Niu

Insufficient recordings and the scarcity of anomalies present significant challenges in developing and validating robust anomaly detection systems for machine sounds. To address these limitations, we propose a novel approach for generating…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Harsh Purohit , Tomoya Nishida , Kota Dohi , Takashi Endo , Yohei Kawaguchi

Realistic music generation is a challenging task. When building generative models of music that are learnt from data, typically high-level representations such as scores or MIDI are used that abstract away the idiosyncrasies of a particular…

Sound · Computer Science 2018-06-28 Sander Dieleman , Aäron van den Oord , Karen Simonyan

Diffusion-based audio and music generation models commonly perform generation by constructing an image representation of audio (e.g., a mel-spectrogram) and then convert it to audio using a phase reconstruction model or vocoder. Typical…

Sound · Computer Science 2024-10-08 Ge Zhu , Juan-Pablo Caceres , Zhiyao Duan , Nicholas J. Bryan

Evaluating generative adversarial networks (GANs) is inherently challenging. In this paper, we revisit several representative sample-based evaluation metrics for GANs, and address the problem of how to evaluate the evaluation metrics. We…

Machine Learning · Computer Science 2018-08-20 Qiantong Xu , Gao Huang , Yang Yuan , Chuan Guo , Yu Sun , Felix Wu , Kilian Weinberger

The growing popularity of generative music models underlines the need for perceptually relevant, objective music quality metrics. The Frechet Audio Distance (FAD) is commonly used for this purpose even though its correlation with perceptual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-07 Azalea Gui , Hannes Gamper , Sebastian Braun , Dimitra Emmanouilidou

Influenced by the field of Computer Vision, Generative Adversarial Networks (GANs) are often adopted for the audio domain using fixed-size two-dimensional spectrogram representations as the "image data". However, in the (musical) audio…

Sound · Computer Science 2021-08-02 Javier Nistal , Cyran Aouameur , Stefan Lattner , Gaël Richard

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

Generative adversarial networks (GANs) have great successes on synthesizing data. However, the existing GANs restrict the discriminator to be a binary classifier, and thus limit their learning capacity for tasks that need to synthesize…

Computation and Language · Computer Science 2018-04-17 Kevin Lin , Dianqi Li , Xiaodong He , Zhengyou Zhang , Ming-Ting Sun

While recent years have seen remarkable progress in music generation models, research on their biases across countries, languages, cultures, and musical genres remains underexplored. This gap is compounded by the lack of datasets and…

Sound · Computer Science 2025-10-03 Ahmet Solak , Florian Grötschla , Luca A. Lanzendörfer , Roger Wattenhofer

Music demixing is the task of separating different tracks from the given single audio signal into components, such as drums, bass, and vocals from the rest of the accompaniment. Separation of sources is useful for a range of areas,…

Sound · Computer Science 2024-05-08 Roman Solovyev , Alexander Stempkovskiy , Tatiana Habruseva