English
Related papers

Related papers: Music generation with variational recurrent autoen…

200 papers

We demonstrate a conditional autoregressive pipeline for efficient music recomposition, based on methods presented in van den Oord et al.(2017). Recomposition (Casal & Casey, 2010) focuses on reworking existing musical pieces, adhering to…

Sound · Computer Science 2018-11-20 Kyle Kastner , Rithesh Kumar , Tim Cooijmans , Aaron Courville

Mapping music to dance is a challenging problem that requires spatial and temporal coherence along with a continual synchronization with the music's progression. Taking inspiration from large language models, we introduce a 2-step approach…

Graphics · Computer Science 2023-09-06 Sohan Anisetty , Amit Raj , James Hays

Modelling musical structure is vital yet challenging for artificial intelligence systems that generate symbolic music compositions. This literature review dissects the evolution of techniques for incorporating coherent structure, from…

Sound · Computer Science 2024-03-14 Keshav Bhandari , Simon Colton

We explore recurrent encoder multi-decoder neural network architectures for semi-supervised sequence classification and reconstruction. We find that the use of multiple reconstruction modules helps models generalize in a classification task…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Félix G. Harvey , Julien Roy , David Kanaa , Christopher Pal

Gated recurrent units (GRUs) are specialized memory elements for building recurrent neural networks. Despite their incredible success on various tasks, including extracting dynamics underlying neural data, little is understood about the…

Machine Learning · Computer Science 2021-07-30 Ian D. Jordan , Piotr Aleksander Sokol , Il Memming Park

Score-based generative models and diffusion probabilistic models have been successful at generating high-quality samples in continuous domains such as images and audio. However, due to their Langevin-inspired sampling mechanisms, their…

Sound · Computer Science 2021-11-29 Gautam Mittal , Jesse Engel , Curtis Hawthorne , Ian Simon

Music genre classification is an area that utilizes machine learning models and techniques for the processing of audio signals, in which applications range from content recommendation systems to music recommendation systems. In this…

Sound · Computer Science 2024-05-27 Keoikantse Mogonediwa

A graphical model is a structured representation of the data generating process. The traditional method to reason over random variables is to perform inference in this graphical model. However, in many cases the generating process is only a…

Machine Learning · Statistics 2019-10-31 Victor Garcia Satorras , Zeynep Akata , Max Welling

Deep probabilistic time series forecasting models have become an integral part of machine learning. While several powerful generative models have been proposed, we provide evidence that their associated inference models are oftentimes too…

Machine Learning · Computer Science 2020-12-07 Chen Qiu , Stephan Mandt , Maja Rudolph

Digital advances have transformed the face of automatic music generation since its beginnings at the dawn of computing. Despite the many breakthroughs, issues such as the musical tasks targeted by different machines and the degree to which…

Sound · Computer Science 2018-12-12 Dorien Herremans , Ching-Hua Chuan , Elaine Chew

Being able to generate constrained samples is one of the most appealing applications of the deep generators. Conditional generators are one of the successful implementations of such models wherein the created samples are constrained to a…

Image and Video Processing · Electrical Eng. & Systems 2018-05-29 Shabab Bazrafkan , Peter Corcoran

Successful recurrent models such as long short-term memories (LSTMs) and gated recurrent units (GRUs) use ad hoc gating mechanisms. Empirically these models have been found to improve the learning of medium to long term temporal…

Machine Learning · Computer Science 2018-05-01 Corentin Tallec , Yann Ollivier

In a recent paper, we have presented a generative adversarial network (GAN)-based model for unconditional generation of the mel-spectrograms of singing voices. As the generator of the model is designed to take a variable-length sequence of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-13 Jen-Yu Liu , Yu-Hua Chen , Yin-Cheng Yeh , Yi-Hsuan Yang

Learning in the latent variable model is challenging in the presence of the complex data structure or the intractable latent variable. Previous variational autoencoders can be low effective due to the straightforward encoder-decoder…

Machine Learning · Computer Science 2018-04-13 Jiangchao Yao , Ivor Tsang , Ya Zhang

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical…

Sound · Computer Science 2019-08-09 Jean-Pierre Briot , Gaëtan Hadjeres , François-David Pachet

Deep Learning models have shown very promising results in automatically composing polyphonic music pieces. However, it is very hard to control such models in order to guide the compositions towards a desired goal. We are interested in…

Machine Learning · Computer Science 2021-03-11 Lucas N. Ferreira , Jim Whitehead

Most generative document models act on bag-of-words input in an attempt to focus on the semantic content and thereby partially forego syntactic information. We argue that it is preferable to keep the original word order intact and…

Computation and Language · Computer Science 2018-06-06 Erik Holmer , Andreas Marfurt

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Justin Kilb , Caroline Ellis

Artificial Intelligence and generative models have revolutionized music creation, with many models leveraging textual or visual prompts for guidance. However, existing image-to-music models are limited to simple images, lacking the…

Multimedia · Computer Science 2025-07-31 Ivan Rinaldi , Nicola Fanelli , Giovanna Castellano , Gennaro Vessio

Autoregressive generative transformers are key in music generation, producing coherent compositions but facing challenges in human-machine collaboration. We propose RefinPaint, an iterative technique that improves the sampling process. It…

Sound · Computer Science 2024-11-12 Pedro Ramoneda , Martin Rocamora , Taketo Akama