English
Related papers

Related papers: Structure-informed Positional Encoding for Music G…

200 papers

Hierarchical planning is a powerful approach to model long sequences structurally. Aside from considering hierarchies in the temporal structure of music, this paper explores an even more important aspect: concept hierarchy, which involves…

Sound · Computer Science 2025-07-01 Qi He , Gus Xia , Ziyu Wang

Structure is one of the most essential aspects of music, and music structure is commonly indicated through repetition. However, the nature of repetition and structure in music is still not well understood, especially in the context of music…

Sound · Computer Science 2022-09-02 Shuqi Dai , Huiran Yu , Roger B. Dannenberg

Transformer architectures offer significant advantages regarding the generation of symbolic music; their capabilities for incorporating user preferences toward what they generate is being studied under many aspects. This paper studies the…

We propose a novel method to model hierarchical metrical structures for both symbolic music and audio signals in a self-supervised manner with minimal domain knowledge. The model trains and inferences on beat-aligned music signals and…

Sound · Computer Science 2023-01-26 Junyan Jiang , Gus Xia

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurrent neural network…

Machine Learning · Computer Science 2012-07-03 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

We show that coherent, long-form musical composition can emerge from a decentralized swarm of identical, frozen foundation models that coordinate via stigmergic, peer-to-peer signals, without any weight updates. We compare a centralized…

Artificial Intelligence · Computer Science 2025-09-16 Markus J. Buehler

In this paper, we propose a lightweight music-generating model based on variational autoencoder (VAE) with structured attention. Generating music is different from generating text because the melodies with chords give listeners…

Sound · Computer Science 2020-11-19 Yizhou Zhao , Liang Qiu , Wensi Ai , Feng Shi , Song-Chun Zhu

Discovering and exploring the underlying structure of multi-instrumental music using learning-based approaches remains an open problem. We extend the recent MusicVAE model to represent multitrack polyphonic measures as vectors in a latent…

Machine Learning · Statistics 2018-06-04 Ian Simon , Adam Roberts , Colin Raffel , Jesse Engel , Curtis Hawthorne , Douglas Eck

We propose the Multi-Track Music Machine (MMM), a generative system based on the Transformer architecture that is capable of generating multi-track music. In contrast to previous work, which represents musical material as a single…

Sound · Computer Science 2020-08-24 Jeff Ens , Philippe Pasquier

Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly challenging. This paper introduces 1) a new variant of…

Artificial Intelligence · Computer Science 2018-11-02 Yu-An Wang , Yu-Kai Huang , Tzu-Chuan Lin , Shang-Yu Su , Yun-Nung Chen

Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality itself, e.g., as sequences of symbolic notes. This observation…

Sound · Computer Science 2025-09-30 Junyan Jiang , Daniel Chin , Liwei Lin , Xuanjie Liu , Gus Xia

The identification of structural differences between a music performance and the score is a challenging yet integral step of audio-to-score alignment, an important subtask of music information retrieval. We present a novel method to detect…

Sound · Computer Science 2021-02-16 Ruchit Agrawal , Daniel Wolff , Simon Dixon

The polyphonic nature of music makes the application of deep learning to music modelling a challenging task. On the other hand, the Transformer architecture seems to be a good fit for this kind of data. In this work, we present Calliope, a…

Sound · Computer Science 2021-07-13 Andrea Valenti , Stefano Berti , Davide Bacciu

In this work, we propose a permutation invariant language model, SymphonyNet, as a solution for symbolic symphony music generation. We propose a novel Multi-track Multi-instrument Repeatable (MMR) representation for symphonic music and…

Sound · Computer Science 2022-09-19 Jiafeng Liu , Yuanliang Dong , Zehua Cheng , Xinran Zhang , Xiaobing Li , Feng Yu , Maosong Sun

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score…

Machine Learning · Computer Science 2020-04-14 Ashis Pati , Alexander Lerch , Gaëtan Hadjeres

Multi-layer perceptrons (MLP) have proven to be effective scene encoders when combined with higher-dimensional projections of the input, commonly referred to as \textit{positional encoding}. However, scenes with a wide frequency spectrum…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Zoe Landgraf , Alexander Sorkine Hornung , Ricardo Silveira Cabral

The ''pretraining-and-finetuning'' paradigm has become a norm for training domain-specific models in natural language processing and computer vision. In this work, we aim to examine this paradigm for symbolic music generation through…

Sound · Computer Science 2023-11-22 Weihan Xu , Julian McAuley , Shlomo Dubnov , Hao-Wen Dong

Automatic generation of sequences has been a highly explored field in the last years. In particular, natural language processing and automatic music composition have gained importance due to the recent advances in machine learning and…

Sound · Computer Science 2020-12-03 Sebastian Garcia-Valencia , Alejandro Betancourt , Juan G. Lalinde-Pulido

Current state-of-the-art AI based classical music creation algorithms such as Music Transformer are trained by employing single sequence of notes with time-shifts. The major drawback of absolute time interval expression is the difficulty of…

Sound · Computer Science 2020-07-15 Xianchao Wu , Chengyuan Wang , Qinying Lei

Music Information Retrieval (MIR) has seen a recent surge in deep learning-based approaches, which often involve encoding symbolic music (i.e., music represented in terms of discrete note events) in an image-like or language like fashion.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-12 Huan Zhang , Emmanouil Karystinaios , Simon Dixon , Gerhard Widmer , Carlos Eduardo Cancino-Chacón