English
Related papers

Related papers: Multi-Genre Music Transformer -- Composing Full Le…

200 papers

With rapid advances in generative artificial intelligence, the text-to-music synthesis task has emerged as a promising direction for music generation. Nevertheless, achieving precise control over multi-track generation remains an open…

Sound · Computer Science 2024-12-18 Yao Yao , Peike Li , Boyu Chen , Alex Wang

This paper presents the Jazz Transformer, a generative model that utilizes a neural sequence model called the Transformer-XL for modeling lead sheets of Jazz music. Moreover, the model endeavors to incorporate structural events present in…

Sound · Computer Science 2020-08-05 Shih-Lun Wu , Yi-Hsuan Yang

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical…

Sound · Computer Science 2019-08-09 Jean-Pierre Briot , Gaëtan Hadjeres , François-David Pachet

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

Automatic Music Transcription (AMT), inferring musical notes from raw audio, is a challenging task at the core of music understanding. Unlike Automatic Speech Recognition (ASR), which typically focuses on the words of a single speaker, AMT…

Sound · Computer Science 2022-03-16 Josh Gardner , Ian Simon , Ethan Manilow , Curtis Hawthorne , Jesse Engel

Conditional music generation offers significant advantages in terms of user convenience and control, presenting great potential in AI-generated content research. However, building conditional generative systems for multitrack popular songs…

Sound · Computer Science 2025-10-27 Jing Luo , Xinyu Yang , Dorien Herremans

Symbolic music generation aims to generate music scores automatically. A recent trend is to use Transformer or its variants in music generation, which is, however, suboptimal, because the full attention cannot efficiently model the…

Sound · Computer Science 2022-11-01 Botao Yu , Peiling Lu , Rui Wang , Wei Hu , Xu Tan , Wei Ye , Shikun Zhang , Tao Qin , Tie-Yan Liu

In the realm of music AI, arranging rich and structured multi-track accompaniments from a simple lead sheet presents significant challenges. Such challenges include maintaining track cohesion, ensuring long-term coherence, and optimizing…

Sound · Computer Science 2024-11-26 Jingwei Zhao , Gus Xia , Ziyu Wang , Ye Wang

Composing coherent long-form music remains a significant challenge due to the complexity of modeling long-range dependencies and the prohibitive memory and computational requirements associated with lengthy audio representations. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Jianyi Chen , Rongxiu Zhong , Shilei Zhang , Kun Qian , Jinglei Liu , Yike Guo , Wei Xue

Creating a complex work of art like music necessitates profound creativity. With recent advancements in deep learning and powerful models such as transformers, there has been huge progress in automatic music generation. In an accompaniment…

Sound · Computer Science 2022-09-02 Rishabh Dahale , Vaibhav Talwadker , Preeti Rao , Prateek Verma

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic…

Sound · Computer Science 2021-09-08 Carlos Hernandez-Olivan , Jose R. Beltran

Music is one of the Gardner's intelligences in his theory of multiple intelligences. How humans perceive and understand music is still being studied and is crucial to develop artificial intelligence models that imitate such processes. Music…

Artificial Intelligence · Computer Science 2022-11-04 Carlos Hernandez-Olivan , Javier Hernandez-Olivan , Jose R. Beltran

The field of Automatic Music Generation has seen significant progress thanks to the advent of Deep Learning. However, most of these results have been produced by unconditional models, which lack the ability to interact with their users, not…

Sound · Computer Science 2022-12-22 Pedro Neves , Jose Fornari , João Florindo

While recent generative models can produce engaging music, their utility is limited. The variation in the music is often left to chance, resulting in compositions that lack structure. Pieces extending beyond a minute can become incoherent…

Sound · Computer Science 2023-11-01 Lilac Atassi

We present and release MIDI-GPT, a generative system based on the Transformer architecture that is designed for computer-assisted music composition workflows. MIDI-GPT supports the infilling of musical material at the track and bar level,…

Recently, multi-instrument music generation has become a hot topic. Different from single-instrument generation, multi-instrument generation needs to consider inter-track harmony besides intra-track coherence. This is usually achieved by…

Sound · Computer Science 2023-05-29 Xipin Wei , Junhui Chen , Zirui Zheng , Li Guo , Lantian Li , Dong Wang

We consider the problem of learning high-level controls over the global structure of generated sequences, particularly in the context of symbolic music generation with complex language models. In this work, we present the Transformer…

Sound · Computer Science 2020-07-01 Kristy Choi , Curtis Hawthorne , Ian Simon , Monica Dinculescu , Jesse Engel

This paper explores the modeling method of polyphonic music sequence. Due to the great potential of Transformer models in music generation, controllable music generation is receiving more attention. In the task of polyphonic music, current…

Sound · Computer Science 2023-11-29 Jiuyang Zhou , Tengfei Niu , Hong Zhu , Xingping Wang

We propose the Multi-Track Music Machine (MMM), a generative system based on the Transformer architecture that is capable of generating multi-track music. In contrast to previous work, which represents musical material as a single…

Sound · Computer Science 2020-08-24 Jeff Ens , Philippe Pasquier

Audio-based generative models for music have seen great strides recently, but so far have not managed to produce full-length music tracks with coherent musical structure from text prompts. We show that by training a generative model on long…

Sound · Computer Science 2024-07-30 Zach Evans , Julian D. Parker , CJ Carr , Zack Zukowski , Josiah Taylor , Jordi Pons