English
Related papers

Related papers: Generating Music using an LSTM Network

200 papers

Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality itself, e.g., as sequences of symbolic notes. This observation…

Sound · Computer Science 2025-09-30 Junyan Jiang , Daniel Chin , Liwei Lin , Xuanjie Liu , Gus Xia

Artificial Intelligence and generative models have revolutionized music creation, with many models leveraging textual or visual prompts for guidance. However, existing image-to-music models are limited to simple images, lacking the…

Multimedia · Computer Science 2025-07-31 Ivan Rinaldi , Nicola Fanelli , Giovanna Castellano , Gennaro Vessio

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good…

Sound · Computer Science 2020-08-18 Ziyu Wang , Dingsu Wang , Yixiao Zhang , Gus Xia

Human usually composes music by organizing elements according to the musical form to express music ideas. However, for neural network-based music generation, it is difficult to do so due to the lack of labelled data on musical form. In this…

Sound · Computer Science 2022-08-31 Peiling Lu , Xu Tan , Botao Yu , Tao Qin , Sheng Zhao , Tie-Yan Liu

Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is constructed (notes,…

Machine Learning · Statistics 2016-06-13 Pablo A. Alvarado , Dan Stowell

It has been shown recently that deep convolutional generative adversarial networks (GANs) can learn to generate music in the form of piano-rolls, which represent music by binary-valued time-pitch matrices. However, existing models can only…

Machine Learning · Computer Science 2018-10-09 Hao-Wen Dong , Yi-Hsuan Yang

Deep learning has been demonstrated its effectiveness and efficiency in music genre classification. However, the existing achievements still have several shortcomings which impair the performance of this classification task. In this paper,…

Sound · Computer Science 2017-12-25 Lin Feng , Shenlan Liu , Jianing Yao

We use a modified SampleRNN architecture to generate music in modern genres such as black metal and math rock. Unlike MIDI and symbolic models, SampleRNN generates raw audio in the time domain. This requirement becomes increasingly…

Sound · Computer Science 2018-11-19 Zack Zukowski , CJ Carr

Based on a review of anecdotal beliefs, we explored patterns of track-sequencing within professional music albums. We found that songs with high levels of valence, energy and loudness are more likely to be positioned at the beginning of…

Multimedia · Computer Science 2024-08-09 Pedro Neto , Martin Hartmann , Geoff Luck , Petri Toiviainen

We introduce MusicLM, a model generating high-fidelity music from text descriptions such as "a calming violin melody backed by a distorted guitar riff". MusicLM casts the process of conditional music generation as a hierarchical…

In tasks like semantic parsing, instruction following, and question answering, standard deep networks fail to generalize compositionally from small datasets. Many existing approaches overcome this limitation with model architectures that…

Computation and Language · Computer Science 2023-07-06 Ekin Akyürek , Jacob Andreas

Even when neural networks are widely used in a large number of applications, they are still considered as black boxes and present some difficulties for dimensioning or evaluating their prediction error. This has led to an increasing…

Machine Learning · Statistics 2021-05-11 Pablo Morala , Jenny Alexandra Cifuentes , Rosa E. Lillo , Iñaki Ucar

Hand in hand with deep learning advancements, algorithms of music composition increase in performance. However, most of the successful models are designed for specific musical structures. Here, we present BachProp, an algorithmic composer…

Sound · Computer Science 2018-02-21 Florian Colombo , Wulfram Gerstner

This paper proposes a general method for improving the structure and quality of sequences generated by a recurrent neural network (RNN), while maintaining information originally learned from data, as well as sample diversity. An RNN is…

Pattern formation of sound is predicted in a driven resonator where subharmonic generation takes place. A model allowing for diffraction of the fields (large-aspect ratio limit) is derived by means of the multiple scale expansions…

Pattern Formation and Solitons · Physics 2009-11-11 Isabel Perez-Arjona , Victor J. Sanchez-Morcillo

The analysis of the structure of musical pieces is a task that remains a challenge for Artificial Intelligence, especially in the field of Deep Learning. It requires prior identification of structural boundaries of the music pieces. This…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-02 Carlos Hernandez-Olivan , Jose R. Beltran , David Diaz-Guerra

We contribute a pop-song automation framework for lead melody generation and accompaniment arrangement. The framework reflects the major procedures of human music composition, generating both lead melody and piano accompaniment by a unified…

Sound · Computer Science 2018-12-31 Ziyu Wang , Gus Xia

Melody generation from lyrics has been a challenging research issue in the field of artificial intelligence and music, which enables to learn and discover latent relationship between interesting lyrics and accompanying melody.…

Artificial Intelligence · Computer Science 2021-04-22 Yi Yu , Abhishek Srivastava , Simon Canales

In addition to traditional tasks such as prediction, classification and translation, deep learning is receiving growing attention as an approach for music generation, as witnessed by recent research groups such as Magenta at Google and CTRL…

Sound · Computer Science 2018-11-13 Jean-Pierre Briot , François Pachet