English
Related papers

Related papers: Setting the rhythm scene: deep learning-based drum…

200 papers

The ability to automatically generate music that appropriately matches an arbitrary input track is a challenging task. We present a novel controllable system for generating single stems to accompany musical mixes of arbitrary length. At the…

Sound · Computer Science 2024-02-05 Marco Pasini , Maarten Grachten , Stefan Lattner

The current wave of deep learning (the hyper-vitamined return of artificial neural networks) applies not only to traditional statistical machine learning tasks: prediction and classification (e.g., for weather prediction and pattern…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-07 Jean-Pierre Briot

In this paper, we present a novel state of the art system for automatic downbeat tracking from music signals. The audio signal is first segmented in frames which are synchronized at the tatum level of the music. We then extract different…

Sound · Computer Science 2016-05-27 S. Durand , J. P. Bello , B. David , G. Richard

While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good…

Sound · Computer Science 2020-08-18 Ziyu Wang , Dingsu Wang , Yixiao Zhang , Gus Xia

We apply deep learning methods, specifically long short-term memory (LSTM) networks, to music transcription modelling and composition. We build and train LSTM networks using approximately 23,000 music transcriptions expressed with a…

Sound · Computer Science 2016-05-02 Bob L. Sturm , João Felipe Santos , Oded Ben-Tal , Iryna Korshunova

Poetry Generation involves teaching systems to automatically generate text that resembles poetic work. A deep learning system can learn to generate poetry on its own by training on a corpus of poems and modeling the particular style of…

Computation and Language · Computer Science 2020-02-10 Brendan Bena , Jugal Kalita

The utilization of deep learning techniques in generating various contents (such as image, text, etc.) has become a trend. Especially music, the topic of this paper, has attracted widespread attention of countless researchers.The whole…

Sound · Computer Science 2020-11-16 Shulei Ji , Jing Luo , Xinyu Yang

The use of deep learning to solve problems in literary arts has been a recent trend that has gained a lot of attention and automated generation of music has been an active area. This project deals with the generation of music using raw…

Sound · Computer Science 2016-12-16 Vasanth Kalingeri , Srikanth Grandhe

Automatic drum transcription, a subtask of the more general automatic music transcription, deals with extracting drum instrument note onsets from an audio source. Recently, progress in transcription performance has been made using…

Sound · Computer Science 2018-10-04 Richard Vogl , Gerhard Widmer , Peter Knees

Music accompaniment generation is a crucial aspect in the composition process. Deep neural networks have made significant strides in this field, but it remains a challenge for AI to effectively incorporate human emotions to create beautiful…

Sound · Computer Science 2023-07-11 Qi Wang , Shubing Zhang , Li Zhou

Automatic melody generation for pop music has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melody has turned out to be highly challenging due to a number of factors.…

One of the challenging problems in Music Information Retrieval is the acquisition of enough non-copyrighted audio recordings for model training and evaluation. This study compares two Transformer-based neural network models for chord…

Sound · Computer Science 2025-08-11 Martyna Majchrzak , Jacek Mańdziuk

Sequence modeling with neural networks has lead to powerful models of symbolic music data. We address the problem of exploiting these models to reach creative musical goals, by combining with human input. To this end we generalise previous…

Artificial Intelligence · Computer Science 2017-10-03 Christian Walder , Dongwoo Kim

This work introduces the M6(GPT)3 composer system, capable of generating complete, multi-minute musical compositions with complex structures in any time signature, in the MIDI domain from input descriptions in natural language. The system…

Sound · Computer Science 2025-09-30 Jakub Poćwiardowski , Mateusz Modrzejewski , Marek S. Tatara

Machine learning is the capacity of a computational system to learn structures from datasets in order to make predictions on newly seen data. Such an approach offers a significant advantage in music scenarios in which musicians can teach…

Human-Computer Interaction · Computer Science 2016-11-03 Rebecca Fiebrink , Baptiste Caramiaux

Research on automatic music generation has seen great progress due to the development of deep neural networks. However, the generation of multi-instrument music of arbitrary genres still remains a challenge. Existing research either works…

Sound · Computer Science 2018-07-31 Hao-Min Liu , Yi-Hsuan Yang

Conventional music visualisation systems rely on handcrafted ad hoc transformations of shapes and colours that offer only limited expressiveness. We propose two novel pipelines for automatically generating music videos from any…

Creating a pop song melody according to pre-written lyrics is a typical practice for composers. A computational model of how lyrics are set as melodies is important for automatic composition systems, but an end-to-end lyric-to-melody model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-05 Daiyu Zhang , Ju-Chiang Wang , Katerina Kosta , Jordan B. L. Smith , Shicen Zhou

In this paper, we propose a new system design framework for large vocabulary automatic chord estimation. Our approach is based on an integration of traditional sequence segmentation processes and deep learning chord classification…

Sound · Computer Science 2017-09-25 Junqi Deng , Yu-Kwong Kwok

Hand in hand with deep learning advancements, algorithms of music composition increase in performance. However, most of the successful models are designed for specific musical structures. Here, we present BachProp, an algorithmic composer…

Sound · Computer Science 2018-02-21 Florian Colombo , Wulfram Gerstner