English
Related papers

Related papers: DeepRapper: Neural Rap Generation with Rhyme and R…

200 papers

Deep learning algorithms are increasingly developed for learning to compose music in the form of MIDI files. However, whether such algorithms work well for composing guitar tabs, which are quite different from MIDIs, remain relatively…

Sound · Computer Science 2020-08-05 Yu-Hua Chen , Yu-Hsiang Huang , Wen-Yi Hsiao , Yi-Hsuan Yang

This paper addresses the issue of long-scale correlations that is characteristic for symbolic music and is a challenge for modern generative algorithms. It suggests a very simple workaround for this challenge, namely, generation of a drum…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-21 Alexey Tikhonov , Ivan P. Yamshchikov

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

We describe a system based on deep learning that generates drum patterns in the electronic dance music domain. Experimental results reveal that generated patterns can be employed to produce musically sound and creative transitions between…

Numerical reasoning over hybrid data containing tables and long texts has recently received research attention from the AI community. To generate an executable reasoning program consisting of math and table operations to answer a question,…

Computation and Language · Computer Science 2022-11-24 Xiao Li , Yin Zhu , Sichen Liu , Jiangzhou Ju , Yuzhong Qu , Gong Cheng

Our goal is to be able to build a generative model from a deep neural network architecture to try to create music that has both harmony and melody and is passable as music composed by humans. Previous work in music generation has mainly…

Machine Learning · Computer Science 2016-06-16 Allen Huang , Raymond Wu

Existing recurrent neural language models often fail to capture higher-level structure present in text: for example, rhyming patterns present in poetry. Much prior work on poetry generation uses manually defined constraints which are…

Computation and Language · Computer Science 2019-09-17 Harsh Jhamtani , Sanket Vaibhav Mehta , Jaime Carbonell , Taylor Berg-Kirkpatrick

We present a new model for singing synthesis based on a modified version of the WaveNet architecture. Instead of modeling raw waveform, we model features produced by a parametric vocoder that separates the influence of pitch and timbre.…

Sound · Computer Science 2017-08-18 Merlijn Blaauw , Jordi Bonada

We propose a deep attention-based alignment network, which aims to automatically predict lyrics and melody with given incomplete lyrics as input in a way similar to the music creation of humans. Most importantly, a deep neural…

Sound · Computer Science 2023-01-25 Gurunath Reddy M , Zhe Zhang , Yi Yu , Florian Harscoet , Simon Canales , Suhua Tang

Polyphonic music generation is still a challenge direction due to its correct between generating melody and harmony. Most of the previous studies used RNN-based models. However, the RNN-based models are hard to establish the relationship…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-08 Jiuyang Zhou , Hong Zhu , Xingping Wang

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical…

Sound · Computer Science 2019-08-09 Jean-Pierre Briot , Gaëtan Hadjeres , François-David Pachet

Recent advances in deep neural networks have enabled algorithms to compose music that is comparable to music composed by humans. However, few algorithms allow the user to generate music with tunable parameters. The ability to tune…

Sound · Computer Science 2018-02-06 Huanru Henry Mao , Taylor Shin , Garrison W. Cottrell

Writers, poets, singers usually do not create their compositions in just one breath. Text is revisited, adjusted, modified, rephrased, even multiple times, in order to better convey meanings, emotions and feelings that the author wants to…

Computation and Language · Computer Science 2021-02-09 Andrea Zugarini , Luca Pasqualini , Stefano Melacci , Marco Maggini

Formal verse poetry imposes strict constraints on the meter and rhyme scheme of poems. Most prior work on generating this type of poetry uses existing poems for supervision, which are difficult to obtain for most languages and poetic forms.…

Computation and Language · Computer Science 2022-10-31 Aitor Ormazabal , Mikel Artetxe , Manex Agirrezabal , Aitor Soroa , Eneko Agirre

In this paper, we propose a technique to address the most challenging aspect of algorithmic songwriting process, which enables the human community to discover original lyrics, and melodies suitable for the generated lyrics. The proposed…

Sound · Computer Science 2020-11-13 Gurunath Reddy Madhumani , Yi Yu , Florian Harscoët , Simon Canales , Suhua Tang

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

Computation and Language · Computer Science 2017-11-28 Ziang Xie

While most music generation models generate a mixture of stems (in mono or stereo), we propose to train a multi-stem generative model with 3 stems (bass, drums and other) that learn the musical dependencies between them. To do so, we train…

Sound · Computer Science 2025-01-08 Simon Rouard , Robin San Roman , Yossi Adi , Axel Roebel

Lyrics-to-melody generation is an interesting and challenging topic in AI music research field. Due to the difficulty of learning the correlations between lyrics and melody, previous methods suffer from low generation quality and lack of…

Sound · Computer Science 2023-06-06 Zhe Zhang , Yi Yu , Atsuhiro Takasu

Neural data-to-text generation models have achieved significant advancement in recent years. However, these models have two shortcomings: the generated texts tend to miss some vital information, and they often generate descriptions that are…

Computation and Language · Computer Science 2020-04-21 Kai Chen , Fayuan Li , Baotian Hu , Weihua Peng , Qingcai Chen , Hong Yu

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…