English
Related papers

Related papers: Melody Structure Transfer Network: Generating Musi…

200 papers

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

End-to-end generation of musical audio using deep learning techniques has seen an explosion of activity recently. However, most models concentrate on generating fully mixed music in response to abstract conditioning information. In this…

Stylistic text generation plays a vital role in enhancing communication by reflecting the nuances of individual expression. This paper presents a novel approach for generating text in a specific speaker's style across different languages.…

Computation and Language · Computer Science 2025-01-23 Karishma Thakrar , Katrina Lawrence , Kyle Howard

Recent advancements in song generation have shown promising results in generating songs from lyrics and/or global text prompts. However, most existing systems lack the ability to model the temporally varying attributes of songs, limiting…

Sound · Computer Science 2026-05-29 Pengfei Cai , Joanna Wang , Haorui Zheng , Xu Li , Zihao Ji , Teng Ma , Zhongliang Liu , Chen Zhang , Pengfei Wan

In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting. Motivated by recent advances in the computer vision domain, we are the first to explore the combination of pre-trained text-to-audio…

Automatic music generation systems have gained in popularity and sophistication as advances in cloud computing have enabled large-scale complex computations such as deep models and optimization algorithms on personal devices. Yet, they…

Sound · Computer Science 2018-12-13 Dorien Herremans , Elaine Chew

Music is a repetition of patterns and rhythms. It can be composed by repeating a certain number of bars in a structured way. In this paper, the objective is to generate a loop of 8 bars that can be used as a building block of music. Even…

Sound · Computer Science 2021-11-16 Sangjun Han , Hyeongrae Ihm , Woohyung Lim

In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by merging existing datasets…

Learning musical structures and composition patterns is necessary for both music generation and understanding, but current methods do not make uniform use of learned features to generate and comprehend music simultaneously. In this paper,…

Sound · Computer Science 2024-12-10 Xiao Liang , Zijian Zhao , Weichao Zeng , Yutong He , Fupeng He , Yiyi Wang , Chengying Gao

Despite progress in melody-to-lyric generation, a substantial singability gap remains between machine-generated lyrics and those written by human lyricists. In this work, we aim to narrow this gap by jointly learning both wording and…

Computation and Language · Computer Science 2025-12-15 Longshen Ou , Xichu Ma , Ye Wang

We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) conditioned asynchronously on realizations of a second, correlated process (the control process). We…

Sound · Computer Science 2024-07-29 John Thickstun , David Hall , Chris Donahue , Percy Liang

Realistic music generation has always remained as a challenging problem as it may lack structure or rationality. In this work, we propose a deep learning based music generation method in order to produce old style music particularly JAZZ…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Gullapalli Keerti , A N Vaishnavi , Prerana Mukherjee , A Sree Vidya , Gattineni Sai Sreenithya , Deeksha Nayab

We propose an application of sequence generative adversarial networks (SeqGAN), which are generative adversarial networks for discrete sequence generation, for creating polyphonic musical sequences. Instead of a monophonic melody generation…

Sound · Computer Science 2018-07-03 Sang-gil Lee , Uiwon Hwang , Seonwoo Min , Sungroh Yoon

We propose a novel approach for the generation of polyphonic music based on LSTMs. We generate music in two steps. First, a chord LSTM predicts a chord progression based on a chord embedding. A second LSTM then generates polyphonic music…

Sound · Computer Science 2017-11-22 Gino Brunner , Yuyi Wang , Roger Wattenhofer , Jonas Wiesendanger

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…

Audio-based generative models for music have seen great strides recently, but so far have not managed to produce full-length music tracks with coherent musical structure from text prompts. We show that by training a generative model on long…

Sound · Computer Science 2024-07-30 Zach Evans , Julian D. Parker , CJ Carr , Zack Zukowski , Josiah Taylor , Jordi Pons

Research on automatic music generation has seen great progress due to the development of deep neural networks. However, the generation of multi-instrument music of arbitrary genres still remains a challenge. Existing research either works…

Sound · Computer Science 2018-07-31 Hao-Min Liu , Yi-Hsuan Yang

In this paper, we tackle the problem of transfer learning for Jazz automatic generation. Jazz is one of representative types of music, but the lack of Jazz data in the MIDI format hinders the construction of a generative model for Jazz.…

Sound · Computer Science 2019-08-27 Hsiao-Tzu Hung , Chung-Yang Wang , Yi-Hsuan Yang , Hsin-Min Wang

This paper describes a data-driven framework to parse musical sequences into dependency trees, which are hierarchical structures used in music cognition research and music analysis. The parsing involves two steps. First, the input sequence…

Sound · Computer Science 2023-06-30 Francesco Foscarin , Daniel Harasim , Gerhard Widmer

Music that is generated by recurrent neural networks often lacks a sense of direction and coherence. We therefore propose a two-stage LSTM-based model for lead sheet generation, in which the harmonic and rhythmic templates of the song are…

Sound · Computer Science 2020-02-25 Cedric De Boom , Stephanie Van Laere , Tim Verbelen , Bart Dhoedt