English
Related papers

Related papers: Controllable deep melody generation via hierarchic…

200 papers

High-level musical qualities (such as emotion) are often abstract, subjective, and hard to quantify. Given these difficulties, it is not easy to learn good feature representations with supervised learning techniques, either because of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Hao Hao Tan , Dorien Herremans

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

While many topics of the learning-based approach to automated music generation are under active research, musical form is under-researched. In particular, recent methods based on deep learning models generate music that, at the largest time…

Sound · Computer Science 2024-04-19 Lilac Atassi

Controllable music generation remains a significant challenge, with existing methods often requiring model retraining or introducing audible artifacts. We introduce MusicRFM, a framework that adapts Recursive Feature Machines (RFMs) to…

Machine Learning · Computer Science 2026-04-06 Daniel Zhao , Daniel Beaglehole , Taylor Berg-Kirkpatrick , Julian McAuley , Zachary Novack

Music rearrangement involves reshuffling, deleting, and repeating sections of a music piece with the goal of producing a standalone version that has a different duration. It is a creative and time-consuming task commonly performed by an…

Sound · Computer Science 2023-05-15 Christos Plachouras , Marius Miron

We introduce Seed-Music, a suite of music generation systems capable of producing high-quality music with fine-grained style control. Our unified framework leverages both auto-regressive language modeling and diffusion approaches to support…

Artificial Intelligence (AI) for music generation is undergoing rapid developments, with recent symbolic models leveraging sophisticated deep learning and diffusion model algorithms. One drawback with existing models is that they lack…

Sound · Computer Science 2025-10-14 Stephen Ni-Hahn , Chao Péter Yang , Mingchen Ma , Cynthia Rudin , Simon Mak , Yue Jiang

Creating a complex work of art like music necessitates profound creativity. With recent advancements in deep learning and powerful models such as transformers, there has been huge progress in automatic music generation. In an accompaniment…

Sound · Computer Science 2022-09-02 Rishabh Dahale , Vaibhav Talwadker , Preeti Rao , Prateek Verma

While deep generative models have empowered music generation, it remains a challenging and under-explored problem to edit an existing musical piece at fine granularity. In this paper, we propose SDMuse, a unified Stochastic Differential…

Sound · Computer Science 2022-11-03 Chen Zhang , Yi Ren , Kejun Zhang , Shuicheng Yan

In pop music, accompaniments are usually played by multiple instruments (tracks) such as drum, bass, string and guitar, and can make a song more expressive and contagious by arranging together with its melody. Previous works usually…

Sound · Computer Science 2020-08-19 Yi Ren , Jinzheng He , Xu Tan , Tao Qin , Zhou Zhao , Tie-Yan Liu

Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are currently the more…

Sound · Computer Science 2018-06-27 Rachel Manzelli , Vijay Thakkar , Ali Siahkamari , Brian Kulis

We introduce a film score generation framework to harmonize visual pixels and music melodies utilizing a latent diffusion model. Our framework processes film clips as input and generates music that aligns with a general theme while offering…

Multimedia · Computer Science 2024-11-13 F. Qi , L. Ni , C. Xu

A new architecture of an artificial neural network that helps to generate longer melodic patterns is introduced alongside with methods for post-generation filtering. The proposed approach called variational autoencoder supported by history…

Sound · Computer Science 2021-05-21 Ivan P. Yamshchikov , Alexey Tikhonov

Songs, as a central form of musical art, exemplify the richness of human intelligence and creativity. While recent advances in generative modeling have enabled notable progress in long-form song generation, current systems for full-length…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Huakang Chen , Yuepeng Jiang , Guobin Ma , Chunbo Hao , Shuai Wang , Jixun Yao , Ziqian Ning , Meng Meng , Jian Luan , Lei Xie

Transformer architectures offer significant advantages regarding the generation of symbolic music; their capabilities for incorporating user preferences toward what they generate is being studied under many aspects. This paper studies the…

This work introduces the M6(GPT)3 composer system, capable of generating complete, multi-minute musical compositions with complex structures in any time signature, in the MIDI domain from input descriptions in natural language. The system…

Sound · Computer Science 2025-09-30 Jakub Poćwiardowski , Mateusz Modrzejewski , Marek S. Tatara

Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly challenging. This paper introduces 1) a new variant of…

Artificial Intelligence · Computer Science 2018-11-02 Yu-An Wang , Yu-Kai Huang , Tzu-Chuan Lin , Shang-Yu Su , Yun-Nung Chen

Music that is generated by recurrent neural networks often lacks a sense of direction and coherence. We therefore propose a two-stage LSTM-based model for lead sheet generation, in which the harmonic and rhythmic templates of the song are…

Sound · Computer Science 2020-02-25 Cedric De Boom , Stephanie Van Laere , Tim Verbelen , Bart Dhoedt

Since most of music has repetitive structures from motifs to phrases, repeating musical ideas can be a basic operation for music composition. The basic block that we focus on is conceptualized as loops which are essential ingredients of…

Sound · Computer Science 2022-11-01 Sangjun Han , Hyeongrae Ihm , Moontae Lee , Woohyung Lim

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…