English
Related papers

Related papers: MuseGAN: Multi-track Sequential Generative Adversa…

200 papers

Since most of music has repetitive structures from motifs to phrases, repeating musical ideas can be a basic operation for music composition. The basic block that we focus on is conceptualized as loops which are essential ingredients of…

Sound · Computer Science 2022-11-01 Sangjun Han , Hyeongrae Ihm , Moontae Lee , Woohyung Lim

Music mixing involves combining individual tracks into a cohesive mixture, a task characterized by subjectivity where multiple valid solutions exist for the same input. Existing automatic mixing systems treat this task as a deterministic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-12 Eloi Moliner , Marco A. Martínez-Ramírez , Junghyun Koo , Wei-Hsiang Liao , Kin Wai Cheuk , Joan Serrà , Vesa Välimäki , Yuki Mitsufuji

Since the introduction of deep learning, researchers have proposed content generation systems using deep learning and proved that they are competent to generate convincing content and artistic output, including music. However, one can argue…

Sound · Computer Science 2020-11-30 Nao Tokui

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang

In a recent paper, we have presented a generative adversarial network (GAN)-based model for unconditional generation of the mel-spectrograms of singing voices. As the generator of the model is designed to take a variable-length sequence of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-13 Jen-Yu Liu , Yu-Hua Chen , Yin-Cheng Yeh , Yi-Hsuan Yang

We study the ability of Wasserstein Generative Adversarial Network (WGAN) to generate missing audio content which is, in context, (statistically similar) to the sound and the neighboring borders. We deal with the challenge of audio…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 P. P. Ebner , A. Eltelt

The utilization of deep learning techniques in generating various contents (such as image, text, etc.) has become a trend. Especially music, the topic of this paper, has attracted widespread attention of countless researchers.The whole…

Sound · Computer Science 2020-11-16 Shulei Ji , Jing Luo , Xinyu Yang

Symbolic music generation has attracted increasing attention, while most methods focus on generating short piece (mostly less than 8 bars, and up to 32 bars). Generating long music calls for effective expression of the coherent music…

Sound · Computer Science 2021-07-22 Ning Zhang , Junchi Yan

Sheet music, audio, and lyrics are three main modalities during writing a song. In this paper, we propose an unsupervised generative adversarial alignment representation (UGAAR) model to learn deep discriminative representations shared…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-30 Donghuo Zeng , Yi Yu , Keizo Oyama

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

This paper proposes an extension to the Generative Adversarial Networks (GANs), namely as ARTGAN to synthetically generate more challenging and complex images such as artwork that have abstract characteristics. This is in contrast to most…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Wei Ren Tan , Chee Seng Chan , Hernan Aguirre , Kiyoshi Tanaka

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

We propose a generative framework for multi-track music source separation (MSS) that reformulates the task as conditional discrete token generation. Unlike conventional approaches that directly estimate continuous signals in the time or…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-20 Pengbo Lyu , Xiangyu Zhao , Chengwei Liu , Haoyin Yan , Xiaotao Liang , Hongyu Wang , Shaofei Xue

Music is used to convey emotions, and thus generating emotional music is important in automatic music generation. Previous work on emotional music generation directly uses annotated emotion labels as control signals, which suffers from…

Sound · Computer Science 2023-07-06 Chenfei Kang , Peiling Lu , Botao Yu , Xu Tan , Wei Ye , Shikun Zhang , Jiang Bian

While music generation models have evolved to handle complex multimodal inputs mixing text, lyrics, and reference audio, evaluation mechanisms have lagged behind. In this paper, we bridge this critical gap by establishing a comprehensive…

Modern keyboards allow a musician to play multiple instruments at the same time by assigning zones -- fixed pitch ranges of the keyboard -- to different instruments. In this paper, we aim to further extend this idea and examine the…

Sound · Computer Science 2021-10-22 Hao-Wen Dong , Chris Donahue , Taylor Berg-Kirkpatrick , Julian McAuley

Most existing neural network models for music generation explore how to generate music bars, then directly splice the music bars into a song. However, these methods do not explore the relationship between the bars, and the connected song as…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-05 Xia Liang , Junmin Wu , Yan Yin

Recent advancements in generative models have shown remarkable progress in music generation. However, most existing methods focus on generating monophonic or homophonic music, while the generation of polyphonic and multi-track music with…

Sound · Computer Science 2023-03-15 Hongfei Wang

Generative Adversarial Networks (GAN) have motivated a rapid growth of the domain of computer image synthesis. As almost all the existing image synthesis algorithms consider an image as a pixel matrix, the high-resolution image synthesis is…

Graphics · Computer Science 2022-05-17 Valeria Efimova , Ivan Jarsky , Ilya Bizyaev , Andrey Filchenkov

Providing soundtracks for videos remains a costly and time-consuming challenge for multimedia content creators. We introduce EMSYNC, an automatic video-based symbolic music generator that creates music aligned with a video's emotional…

Sound · Computer Science 2026-02-06 Serkan Sulun , Paula Viana , Matthew E. P. Davies