English
Related papers

Related papers: Melody Classifier with Stacked-LSTM

200 papers

We present a method for the generation of Midi files of piano music. The method models the right and left hands using two networks, where the left hand is conditioned on the right hand. This way, the melody is generated before the harmony.…

Sound · Computer Science 2021-11-29 Or Goren , Eliya Nachmani , Lior Wolf

Deep Learning models have shown very promising results in automatically composing polyphonic music pieces. However, it is very hard to control such models in order to guide the compositions towards a desired goal. We are interested in…

Machine Learning · Computer Science 2021-03-11 Lucas N. Ferreira , Jim Whitehead

This paper explores the idea of utilising Long Short-Term Memory neural networks (LSTMNN) for the generation of musical sequences in ABC notation. The proposed approach takes ABC notations from the Nottingham dataset and encodes it to be…

Sound · Computer Science 2021-06-10 Vaishali Ingale , Anush Mohan , Divit Adlakha , Krishan Kumar , Mohit Gupta

This paper addresses the problem of stylized text generation in a multilingual setup. A version of a language model based on a long short-term memory (LSTM) artificial neural network with extended phonetic and semantic embeddings is used…

Computation and Language · Computer Science 2022-11-15 Alexey Tikhonov , Ivan P. Yamshchikov

Machine Learning models are being utilized extensively to drive recommender systems, which is a widely explored topic today. This is especially true of the music industry, where we are witnessing a surge in growth. Besides a large chunk of…

Information Retrieval · Computer Science 2023-09-26 Rahul Singh , Pranav Kanuparthi

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applications. This paper reviews this field, categorizing music…

Sound · Computer Science 2026-03-09 Shuyu Li , Shulei Ji , Zihao Wang , Songruoyao Wu , Jiaxing Yu , Kejun Zhang

Music classification is a task to classify a music piece into labels such as genres or composers. We propose large-scale MIDI based composer classification systems using GiantMIDI-Piano, a transcription-based dataset. We propose to use…

Sound · Computer Science 2020-10-29 Qiuqiang Kong , Keunwoo Choi , Yuxuan Wang

Creating aesthetically pleasing pieces of art, including music, has been a long-term goal for artificial intelligence research. Despite recent successes of long-short term memory (LSTM) recurrent neural networks (RNNs) in sequential…

Machine Learning · Computer Science 2019-03-25 Zheng Sun , Jiaqi Liu , Zewang Zhang , Jingwen Chen , Zhao Huo , Ching Hua Lee , Xiao Zhang

We apply deep learning methods, specifically long short-term memory (LSTM) networks, to music transcription modelling and composition. We build and train LSTM networks using approximately 23,000 music transcriptions expressed with a…

Sound · Computer Science 2016-05-02 Bob L. Sturm , João Felipe Santos , Oded Ben-Tal , Iryna Korshunova

Coherence and interestingness are two criteria for evaluating the performance of melody harmonization, which aims to generate a chord progression from a symbolic melody. In this study, we apply the concept of orderless NADE, which takes the…

Sound · Computer Science 2021-02-02 Chung-En Sun , Yi-Wei Chen , Hung-Shin Lee , Yen-Hsing Chen , Hsin-Min Wang

Over the past several years, deep learning for sequence modeling has grown in popularity. To achieve this goal, LSTM network structures have proven to be very useful for making predictions for the next output in a series. For instance, a…

Sound · Computer Science 2022-03-24 Michael Conner , Lucas Gral , Kevin Adams , David Hunger , Reagan Strelow , Alexander Neuwirth

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challenges: 1) lyric-melody…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Jiaxing Yu , Xinda Wu , Yunfei Xu , Tieyao Zhang , Songruoyao Wu , Le Ma , Kejun Zhang

Music similarity search is useful for a variety of creative tasks such as replacing one music recording with another recording with a similar "feel", a common task in video editing. For this task, it is typically necessary to define a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Evaluating generative models remains a fundamental challenge, particularly when the goal is to reflect human preferences. In this paper, we use music generation as a case study to investigate the gap between automatic evaluation metrics and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Huan Zhang , Jinhua Liang , Huy Phan , Wenwu Wang , Emmanouil Benetos

With the rapid advancement of Large Language Models (LLMs), AI-driven music generation has become a vibrant and fruitful area of research. However, the representation of musical data remains a significant challenge. To address this, a…

Machine Learning · Computer Science 2025-09-16 Cheng-Yang Tsai , Tzu-Wei Huang , Shao-Yu Wei , Guan-Wei Chen , Hung-Ying Chu , Yu-Cheng Lin

Automatic song writing is a topic of significant practical interest. However, its research is largely hindered by the lack of training data due to copyright concerns and challenged by its creative nature. Most noticeably, prior works often…

In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by merging existing datasets…

The ultimate purpose of generative music AI is music production. The studio-lab, a social form within the art-science branch of cross-disciplinarity, is a way to advance music production with AI music models. During a studio-lab experiment…

Sound · Computer Science 2026-05-18 Emmanuel Deruty , Maarten Grachten

Recent advances in generative models have made it possible to create high-quality, coherent music, with some systems delivering production-level output. Yet, most existing models focus solely on generating music from scratch, limiting their…

Our goal is to be able to build a generative model from a deep neural network architecture to try to create music that has both harmony and melody and is passable as music composed by humans. Previous work in music generation has mainly…

Machine Learning · Computer Science 2016-06-16 Allen Huang , Raymond Wu