English
Related papers

Related papers: Deep Learning Techniques for Music Generation -- A…

200 papers

This paper addresses the issue of long-scale correlations that is characteristic for symbolic music and is a challenge for modern generative algorithms. It suggests a very simple workaround for this challenge, namely, generation of a drum…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-21 Alexey Tikhonov , Ivan P. Yamshchikov

Generative artificial intelligence models can be a valuable aid to music composition and live performance, both to aid the professional musician and to help democratize the music creation process for hobbyists. Here we present a novel…

Sound · Computer Science 2022-09-22 Ignacio J. Tripodi

In this paper, we propose a recurrent neural network (RNN)-based MIDI music composition machine that is able to learn musical knowledge from existing Beatles' songs and generate music in the style of the Beatles with little human…

Sound · Computer Science 2018-12-19 Yichao Zhou , Wei Chu , Sam Young , Xin Chen

We present and release MIDI-GPT, a generative system based on the Transformer architecture that is designed for computer-assisted music composition workflows. MIDI-GPT supports the infilling of musical material at the track and bar level,…

AI music generation is rapidly emerging in the creative industries, enabling intuitive music generation from textual descriptions. However, these systems pose risks in exploitation of copyrighted creations, raising ethical and legal…

Computation and Language · Computer Science 2025-09-25 Jinju Kim , Taehan Kim , Abdul Waheed , Jong Hwan , Rita Singh

In this paper, we propose an efficient and reproducible deep learning model for musical onset detection (MOD). We first review the state-of-the-art deep learning models for MOD, and identify their shortcomings and challenges: (i) the lack…

Sound · Computer Science 2018-06-20 Rong Gong , Xavier Serra

Several adaptations of Transformers models have been developed in various domains since its breakthrough in Natural Language Processing (NLP). This trend has spread into the field of Music Information Retrieval (MIR), including studies…

Information Retrieval · Computer Science 2025-02-24 Dinh-Viet-Toan Le , Louis Bigo , Mikaela Keller , Dorien Herremans

Discovering and exploring the underlying structure of multi-instrumental music using learning-based approaches remains an open problem. We extend the recent MusicVAE model to represent multitrack polyphonic measures as vectors in a latent…

Machine Learning · Statistics 2018-06-04 Ian Simon , Adam Roberts , Colin Raffel , Jesse Engel , Curtis Hawthorne , Douglas Eck

We investigate the problem of transforming an input sequence into a high-dimensional output sequence in order to transcribe polyphonic audio music into symbolic notation. We introduce a probabilistic model based on a recurrent neural…

Machine Learning · Computer Science 2012-12-11 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

The imitation of percussive sounds via the human voice is a natural and effective tool for communicating rhythmic ideas on the fly. Thus, the automatic retrieval of drum sounds using vocal percussion can help artists prototype drum patterns…

Sound · Computer Science 2021-10-19 Alejandro Delgado , SkoT McDonald , Ning Xu , Charalampos Saitis , Mark Sandler

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

Deep representation learning offers a powerful paradigm for mapping input data onto an organized embedding space and is useful for many music information retrieval tasks. Two central methods for representation learning include deep metric…

Sound · Computer Science 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Recent advances in music generation produce impressive samples, however, practical creation still lacks two key capabilities: composer-style structural editing and minute-scale coherence. We present MusicWeaver, a framework for generating…

Sound · Computer Science 2026-01-30 Xuanchen Wang , Heng Wang , Weidong Cai

Distances on symbolic musical sequences are needed for a variety of applications, from music retrieval to automatic music generation. These musical sequences belong to a given corpus (or style) and it is obvious that a good distance on…

Information Retrieval · Computer Science 2017-09-05 Gaëtan Hadjeres , Frank Nielsen

Human usually composes music by organizing elements according to the musical form to express music ideas. However, for neural network-based music generation, it is difficult to do so due to the lack of labelled data on musical form. In this…

Sound · Computer Science 2022-08-31 Peiling Lu , Xu Tan , Botao Yu , Tao Qin , Sheng Zhao , Tie-Yan Liu

Evaluating generative models remains a fundamental challenge, particularly when the goal is to reflect human preferences. In this paper, we use music generation as a case study to investigate the gap between automatic evaluation metrics and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Huan Zhang , Jinhua Liang , Huy Phan , Wenwu Wang , Emmanouil Benetos

This study presents a novel method for generating music visualisers using diffusion models, combining audio input with user-selected artwork. The process involves two main stages: image generation and video creation. First, music captioning…

Multimedia · Computer Science 2024-12-10 Leonardo Pina , Yongmin Li

Musical expressivity and coherence are indispensable in music composition and performance, while often neglected in modern AI generative models. In this work, we introduce a listening-based data-processing technique that captures the…

Sound · Computer Science 2025-03-18 Jingwei Liu

We propose a deep attention-based alignment network, which aims to automatically predict lyrics and melody with given incomplete lyrics as input in a way similar to the music creation of humans. Most importantly, a deep neural…

Sound · Computer Science 2023-01-25 Gurunath Reddy M , Zhe Zhang , Yi Yu , Florian Harscoet , Simon Canales , Suhua Tang

Deep learning-based probabilistic models of musical data are producing increasingly realistic results and promise to enter creative workflows of many kinds. Yet they have been little-studied in a performance setting, where the results of…

Sound · Computer Science 2024-03-20 Victor Shepardson , Jack Armitage , Thor Magnusson