English
Related papers

Related papers: Attentional networks for music generation

200 papers

Symbolic melodies generation is one of the essential tasks for automatic music generation. Recently, models based on neural networks have had a significant influence on generating symbolic melodies. However, the musical context structure is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Haibin Liu , Nan Yan , Lan Wang

The rise of deep learning technologies has quickly advanced many fields, including that of generative music systems. There exist a number of systems that allow for the generation of good sounding short snippets, yet, these generated…

Sound · Computer Science 2021-04-27 Zixun Guo , Makris Dimos , Herremans Dorien

Recurrent neural networks like long short-term memory (LSTM) are important architectures for sequential prediction tasks. LSTMs (and RNNs in general) model sequences along the forward time direction. Bidirectional LSTMs (Bi-LSTMs) on the…

Machine Learning · Statistics 2017-11-16 Samira Shabanian , Devansh Arpit , Adam Trischler , Yoshua Bengio

Music classification between music made by AI or human composers can be done by deep learning networks. We first transformed music samples in midi format to natural language sequences, then classified these samples by mLSTM (multiplicative…

Sound · Computer Science 2020-10-16 Yiting Xia , Yiwei Jiang , Tao Ye

Audio-based generative models for music have seen great strides recently, but so far have not managed to produce full-length music tracks with coherent musical structure from text prompts. We show that by training a generative model on long…

Sound · Computer Science 2024-07-30 Zach Evans , Julian D. Parker , CJ Carr , Zack Zukowski , Josiah Taylor , Jordi Pons

Algorithmic music composition is a way of composing musical pieces with minimal to no human intervention. While recurrent neural networks are traditionally applied to many sequence-to-sequence prediction tasks, including successful…

Machine Learning · Computer Science 2022-11-03 Moseli Mots'oehli , Anna Sergeevna Bosman , Johan Pieter De Villiers

Machine learning techniques, such as Transformers and Long Short-Term Memory (LSTM) networks, play a crucial role in Symbolic Music Generation (SMG). Existing literature indicates a difference between LSTMs and Transformers regarding their…

Machine Learning · Computer Science 2026-03-24 Soudeep Ghoshal , Sandipan Chakraborty , Pradipto Chowdhury , Himanshu Buckchash

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on…

Computation and Language · Computer Science 2015-05-12 Xiangang Li , Xihong Wu

The current era of Natural Language Processing (NLP) is dominated by Transformer models. However, novel architectures relying on recurrent mechanisms, such as xLSTM and Mamba, have been proposed as alternatives to attention-based models.…

Machine Learning · Computer Science 2025-03-25 Abdoul Majid O. Thiombiano , Brahim Hnich , Ali Ben Mrad , Mohamed Wiem Mkaouer

Accurate time series prediction is challenging due to the inherent nonlinearity and sensitivity to initial conditions. We propose a novel approach that enhances neural network predictions through differential learning, which involves…

Machine Learning · Computer Science 2025-03-11 Akash Yadav , Eulalia Nualart

A big challenge in algorithmic composition is to devise a model that is both easily trainable and able to reproduce the long-range temporal dependencies typical of music. Here we investigate how artificial neural networks can be trained on…

Machine Learning · Statistics 2016-06-24 Florian Colombo , Samuel P. Muscinelli , Alexander Seeholzer , Johanni Brea , Wulfram Gerstner

Symbolic music generation has attracted increasing attention, while most methods focus on generating short piece (mostly less than 8 bars, and up to 32 bars). Generating long music calls for effective expression of the coherent music…

Sound · Computer Science 2021-07-22 Ning Zhang , Junchi Yan

Current models for audio--sheet music retrieval via multimodal embedding space learning use convolutional neural networks with a fixed-size window for the input audio. Depending on the tempo of a query performance, this window captures more…

Sound · Computer Science 2018-09-18 Matthias Dorfer , Jan Hajič , Gerhard Widmer

In the domain of algorithmic music composition, machine learning-driven systems eliminate the need for carefully hand-crafting rules for composition. In particular, the capability of recurrent neural networks to learn complex temporal…

Sound · Computer Science 2019-03-05 Harish Kumar , Balaraman Ravindran

Generating a chord progression from a monophonic melody is a challenging problem because a chord progression requires a series of layered notes played simultaneously. This paper presents a novel method of generating chord sequences from a…

Sound · Computer Science 2017-12-05 Hyungui Lim , Seungyeon Rhyu , Kyogu Lee

In recent years, machine learning, and in particular generative adversarial neural networks (GANs) and attention-based neural networks (transformers), have been successfully used to compose and generate music, both melodies and polyphonic…

Memory units have been widely used to enrich the capabilities of deep networks on capturing long-term dependencies in reasoning and prediction tasks, but little investigation exists on deep generative models (DGMs) which are good at…

Machine Learning · Computer Science 2016-05-31 Chongxuan Li , Jun Zhu , Bo Zhang

In this paper, we tackle the problem of transfer learning for Jazz automatic generation. Jazz is one of representative types of music, but the lack of Jazz data in the MIDI format hinders the construction of a generative model for Jazz.…

Sound · Computer Science 2019-08-27 Hsiao-Tzu Hung , Chung-Yang Wang , Yi-Hsuan Yang , Hsin-Min Wang

While both the data volume and heterogeneity of the digital music content is huge, it has become increasingly important and convenient to build a recommendation or search system to facilitate surfacing these content to the user or consumer…

With rapid development of neural networks, deep-learning has been extended to various natural language generation fields, such as machine translation, dialogue generation and even literature creation. In this paper, we propose a theme-aware…

Computation and Language · Computer Science 2019-06-06 Jie Wang , Xinyan Zhao