English
Related papers

Related papers: Moonbeam: A MIDI Foundation Model Using Both Absol…

200 papers

Despite the central role that melody plays in music perception, it remains an open challenge in music information retrieval to reliably detect the notes of the melody present in an arbitrary music recording. A key challenge in melody…

Sound · Computer Science 2022-12-06 Chris Donahue , John Thickstun , Percy Liang

We will introduce BumbleBee, a transformer model that will generate MIDI music data . We will tackle the issue of transformers applied to long sequences by implementing a longformer generative model that uses dilating sliding windows to…

Sound · Computer Science 2021-07-09 Lucas Fenaux , Maria Juliana Quintero

Current methods for Music Structure Analysis (MSA) focus primarily on audio data. While symbolic music can be synthesized into audio and analyzed using existing MSA techniques, such an approach does not exploit symbolic music's rich…

Sound · Computer Science 2025-09-23 Omar Eldeeb , Martin Malandro

We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) conditioned asynchronously on realizations of a second, correlated process (the control process). We…

Sound · Computer Science 2024-07-29 John Thickstun , David Hall , Chris Donahue , Percy Liang

Text-to-music generation technology is progressing rapidly, creating new opportunities for musical composition and editing. However, existing music editing methods often fail to preserve the source music's temporal structure, including…

Sound · Computer Science 2025-11-19 Yi Yang , Haowen Li , Tianxiang Li , Boyu Cao , Xiaohan Zhang , Liqun Chen , Qi Liu

Despite progress in controllable symbolic music generation, data scarcity remains a challenge for certain control modalities. Composer-style music generation is a prime example, as only a few pieces per composer are available, limiting the…

Sound · Computer Science 2025-06-24 Mingyang Yao , Ke Chen

Recent work in the field of symbolic music generation has shown value in using a tokenization based on the GuitarPro format, a symbolic representation supporting guitar expressive attributes, as an input and output representation. We extend…

Sound · Computer Science 2023-07-12 Jackson Loth , Pedro Sarmento , CJ Carr , Zack Zukowski , Mathieu Barthet

Research on style transfer and domain translation has clearly demonstrated the ability of deep learning-based algorithms to manipulate images in terms of artistic style. More recently, several attempts have been made to extend such…

Sound · Computer Science 2021-06-11 Ondřej Cífka , Umut Şimşekli , Gaël Richard

We introduce InspireMusic, a framework integrated super resolution and large language model for high-fidelity long-form music generation. A unified framework generates high-fidelity music, songs, and audio, which incorporates an…

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

This monograph introduces a novel approach to polyphonic music generation by addressing the "Missing Middle" problem through structural inductive bias. Focusing on Beethoven's piano sonatas as a case study, we empirically verify the…

Machine Learning · Computer Science 2026-04-10 Joonwon Seo

We present a new large-scale emotion-labeled symbolic music dataset consisting of 12k MIDI songs. To create this dataset, we first trained emotion classification models on the GoEmotions dataset, achieving state-of-the-art results with a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-28 Serkan Sulun , Pedro Oliveira , Paula Viana

We show that pre-training a Transformer on music before language significantly accelerates language acquisition. Using piano performances (MAESTRO dataset), a developmental pipeline -- music $\to$ poetry $\to$ prose -- yields a $17.5\%$…

Computation and Language · Computer Science 2026-04-24 Yoshinori Nomura

Beat tracking in musical performance MIDI is a challenging and important task for notation-level music transcription and rhythmical analysis, yet existing methods primarily focus on audio-based approaches. This paper proposes an end-to-end…

Sound · Computer Science 2025-07-02 Sebastian Murgul , Michael Heizmann

Music Structure Analysis (MSA) aims to uncover the high-level organization of musical pieces. State-of-the-art methods are often based on supervised deep learning, but these methods are bottlenecked by the need for heavily annotated data…

Sound · Computer Science 2026-03-31 Axel Marmoret

Self-attention is an attention mechanism that learns a representation by relating different positions in the sequence. The transformer, which is a sequence model solely based on self-attention, and its variants achieved state-of-the-art…

Sound · Computer Science 2019-06-13 Minz Won , Sanghyuk Chun , Xavier Serra

Recent advances in generative AI have made music generation a prominent research focus. However, many neural-based models rely on large datasets, raising concerns about copyright infringement and high-performance costs. In contrast, we…

Sound · Computer Science 2025-11-24 Callie C. Liao , Duoduo Liao , Ellie L. Zhang

We present a lightweight latent diffusion model for vocal-conditioned musical accompaniment generation that addresses critical limitations in existing music AI systems. Our approach introduces a novel soft alignment attention mechanism that…

Sound · Computer Science 2026-01-06 Hei Shing Cheung , Boya Zhang , Jonathan H. Chan

Style transfer of polyphonic music recordings is a challenging task when considering the modeling of diverse, imaginative, and reasonable music pieces in the style different from their original one. To achieve this, learning stable…

Sound · Computer Science 2018-11-30 Chien-Yu Lu , Min-Xin Xue , Chia-Che Chang , Che-Rung Lee , Li Su

Symbolic music understanding, which refers to the understanding of music from the symbolic data (e.g., MIDI format, but not audio), covers many music applications such as genre classification, emotion classification, and music pieces…

Sound · Computer Science 2021-06-11 Mingliang Zeng , Xu Tan , Rui Wang , Zeqian Ju , Tao Qin , Tie-Yan Liu