English

MMM : Exploring Conditional Multi-Track Music Generation with the Transformer

Sound 2020-08-24 v2 Machine Learning Multimedia

Abstract

We propose the Multi-Track Music Machine (MMM), a generative system based on the Transformer architecture that is capable of generating multi-track music. In contrast to previous work, which represents musical material as a single time-ordered sequence, where the musical events corresponding to different tracks are interleaved, we create a time-ordered sequence of musical events for each track and concatenate several tracks into a single sequence. This takes advantage of the Transformer's attention-mechanism, which can adeptly handle long-term dependencies. We explore how various representations can offer the user a high degree of control at generation time, providing an interactive demo that accommodates track-level and bar-level inpainting, and offers control over track instrumentation and note density.

Keywords

Cite

@article{arxiv.2008.06048,
  title  = {MMM : Exploring Conditional Multi-Track Music Generation with the Transformer},
  author = {Jeff Ens and Philippe Pasquier},
  journal= {arXiv preprint arXiv:2008.06048},
  year   = {2020}
}
R2 v1 2026-06-23T17:50:38.812Z