English
Related papers

Related papers: A variational autoencoder for music generation con…

200 papers

We propose a molecular generative model based on the conditional variational autoencoder for de novo molecular design. It is specialized to control multiple molecular properties simultaneously by imposing them on a latent space. As a proof…

Machine Learning · Computer Science 2018-06-18 Jaechang Lim , Seongok Ryu , Jin Woo Kim , Woo Youn Kim

This study is a theoretical approach for exploring the applicability of a 2D cellular automaton based on melodic and harmonic intervals in random arrays of musical notes. The aim of this study was to explore alternatives uses for a cellular…

Sound · Computer Science 2024-12-03 Igor Lugo , Martha G. Alatriste-Contreras

Recently, multi-instrument music generation has become a hot topic. Different from single-instrument generation, multi-instrument generation needs to consider inter-track harmony besides intra-track coherence. This is usually achieved by…

Sound · Computer Science 2023-05-29 Xipin Wei , Junhui Chen , Zirui Zheng , Li Guo , Lantian Li , Dong Wang

This work presents a generative neural network that's able to generate expressive piano performance in MIDI format. The musical expressivity is reflected by vivid micro-timing, rich polyphonic texture, varied dynamics, and the sustain pedal…

Sound · Computer Science 2024-12-17 Jingwei Liu

Controllable timbre synthesis has been a subject of research for several decades, and deep neural networks have been the most successful in this area. Deep generative models such as Variational Autoencoders (VAEs) have the ability to…

Sound · Computer Science 2023-07-21 Anastasia Natsiou , Luca Longo , Sean O'Leary

Despite advances in deep algorithmic music generation, evaluation of generated samples often relies on human evaluation, which is subjective and costly. We focus on designing a homogeneous, objective framework for evaluating samples of…

In the stereo-to-multichannel upmixing problem for music, one of the main tasks is to set the directionality of the instrument sources in the multichannel rendering results. In this paper, we propose a modified variational autoencoder model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-24 Haici Yang , Sanna Wager , Spencer Russell , Mike Luo , Minje Kim , Wontak Kim

Music evokes emotion in many people. We introduce a novel way to manipulate the emotional content of a song using AI tools. Our goal is to achieve the desired emotion while leaving the original melody as intact as possible. For this, we…

Sound · Computer Science 2024-06-14 Adel N. Abdalla , Jared Osborne , Razvan Andonie

Variational Autoencoders(VAEs) have already achieved great results on image generation and recently made promising progress on music generation. However, the generation process is still quite difficult to control in the sense that the…

Sound · Computer Science 2019-04-19 Ruihan Yang , Tianyao Chen , Yiyi Zhang , Gus Xia

Despite the innovations in deep learning and generative AI, creating long term structure as well as the layers of repeated structure common in musical works remains an open challenge in music generation. We propose an attention layer that…

Sound · Computer Science 2024-06-27 Sophia Hager , Kathleen Hablutzel , Katherine M. Kinnaird

In this paper we introduce a novel feature augmentation approach for generating structured musical compositions comprising melodies and harmonies. The proposed method augments a connectionist generation model with count-down to song…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-23 Shakeel Raja

End-to-end generation of musical audio using deep learning techniques has seen an explosion of activity recently. However, most models concentrate on generating fully mixed music in response to abstract conditioning information. In this…

In this paper, we propose SinTra, an auto-regressive sequential generative model that can learn from a single multi-track music segment, to generate coherent, aesthetic, and variable polyphonic music of multi-instruments with an arbitrary…

Sound · Computer Science 2022-04-22 Qingwei Song , Qiwei Sun , Dongsheng Guo , Haiyong Zheng

Digital advances have transformed the face of automatic music generation since its beginnings at the dawn of computing. Despite the many breakthroughs, issues such as the musical tasks targeted by different machines and the degree to which…

Sound · Computer Science 2018-12-12 Dorien Herremans , Ching-Hua Chuan , Elaine Chew

In recent years, the quality and public interest in music generation systems have grown, encouraging research into various ways to control these systems. We propose a novel method for controlling surprisal in music generation using sequence…

Sound · Computer Science 2024-08-13 Mathias Rose Bjare , Stefan Lattner , Gerhard Widmer

In recent decades, neuroscientific and psychological research has traced direct relationships between taste and auditory perceptions. This article explores multimodal generative models capable of converting taste information into music,…

Sound · Computer Science 2025-09-01 Matteo Spanio , Massimiliano Zampini , Antonio Rodà , Franco Pierucci

We present an end-to-end system for musical key estimation, based on a convolutional neural network. The proposed system not only out-performs existing key estimation methods proposed in the academic literature; it is also capable of…

Machine Learning · Computer Science 2017-06-12 Filip Korzeniowski , Gerhard Widmer

We introduce MIDI-VAE, a neural network model based on Variational Autoencoders that is capable of handling polyphonic music with multiple instrument tracks, as well as modeling the dynamics of music by incorporating note durations and…

Sound · Computer Science 2018-09-21 Gino Brunner , Andres Konrad , Yuyi Wang , Roger Wattenhofer

In this paper, we propose a recurrent neural network (RNN)-based MIDI music composition machine that is able to learn musical knowledge from existing Beatles' songs and generate music in the style of the Beatles with little human…

Sound · Computer Science 2018-12-19 Yichao Zhou , Wei Chu , Sam Young , Xin Chen

Computer poetry generation is our first step towards computer writing. Writing must have a theme. The current approaches of using sequence-to-sequence models with attention often produce non-thematic poems. We present a novel conditional…

Computation and Language · Computer Science 2020-03-06 Xiaopeng Yang , Xiaowen Lin , Shunda Suo , Ming Li