English
Related papers

Related papers: Modeling the Rhythm from Lyrics for Melody Generat…

200 papers

Lyric-to-melody generation is an important task in automatic songwriting. Previous lyric-to-melody generation systems usually adopt end-to-end models that directly generate melodies from lyrics, which suffer from several issues: 1) lack of…

Sound · Computer Science 2022-11-15 Zeqian Ju , Peiling Lu , Xu Tan , Rui Wang , Chen Zhang , Songruoyao Wu , Kejun Zhang , Xiangyang Li , Tao Qin , Tie-Yan Liu

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alignment between the…

Computation and Language · Computer Science 2018-09-13 Hangbo Bao , Shaohan Huang , Furu Wei , Lei Cui , Yu Wu , Chuanqi Tan , Songhao Piao , Ming Zhou

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challenges: 1) lyric-melody…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Jiaxing Yu , Xinda Wu , Yunfei Xu , Tieyao Zhang , Songruoyao Wu , Le Ma , Kejun Zhang

This paper presents a novel, syllable-structured Chinese lyrics generation model given a piece of original melody. Most previously reported lyrics generation models fail to include the relationship between lyrics and melody. In this work,…

Computation and Language · Computer Science 2019-06-25 Xu Lu , Jie Wang , Bojin Zhuang , Shaojun Wang , Jing Xiao

Lyric-to-melody generation is an important task in songwriting, and is also quite challenging due to its unique characteristics: the generated melodies should not only follow good musical patterns, but also align with features in lyrics…

Sound · Computer Science 2023-01-31 Ang Lv , Xu Tan , Tao Qin , Tie-Yan Liu , Rui Yan

Despite progress in melody-to-lyric generation, a substantial singability gap remains between machine-generated lyrics and those written by human lyricists. In this work, we aim to narrow this gap by jointly learning both wording and…

Computation and Language · Computer Science 2025-12-15 Longshen Ou , Xichu Ma , Ye Wang

Although lyrics generation has achieved significant progress in recent years, it has limited practical applications because the generated lyrics cannot be performed without composing compatible melodies. In this work, we bridge this…

Computation and Language · Computer Science 2023-05-29 Yusen Sun , Liangyou Li , Qun Liu , Dit-Yan Yeung

Lyrics-to-melody generation is an interesting and challenging topic in AI music research field. Due to the difficulty of learning the correlations between lyrics and melody, previous methods suffer from low generation quality and lack of…

Sound · Computer Science 2023-06-06 Zhe Zhang , Yi Yu , Atsuhiro Takasu

Automatic melody generation for pop music has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melody has turned out to be highly challenging due to a number of factors.…

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despite achievements in…

Sound · Computer Science 2025-06-03 Shuangrui Ding , Zihan Liu , Xiaoyi Dong , Pan Zhang , Rui Qian , Junhao Huang , Conghui He , Dahua Lin , Jiaqi Wang

Generative Large Language Models have shown impressive in-context learning abilities, performing well across various tasks with just a prompt. Previous melody-to-lyric research has been limited by scarce high-quality aligned data and…

Computation and Language · Computer Science 2024-10-03 Hong-Hsiang Liu , Yi-Wen Liu

We contribute a pop-song automation framework for lead melody generation and accompaniment arrangement. The framework reflects the major procedures of human music composition, generating both lead melody and piano accompaniment by a unified…

Sound · Computer Science 2018-12-31 Ziyu Wang , Gus Xia

Automatic song writing is a topic of significant practical interest. However, its research is largely hindered by the lack of training data due to copyright concerns and challenged by its creative nature. Most noticeably, prior works often…

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

Music is inherently made up of complex structures, and representing them as graphs helps to capture multiple levels of relationships. While music generation has been explored using various deep generation techniques, research on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Wen Qing Lim , Jinhua Liang , Huan Zhang

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at…

Computation and Language · Computer Science 2024-01-31 Zhe Zhang , Karol Lasocki , Yi Yu , Atsuhiro Takasu

Large Language Models (LLMs) show promise in lyric-to-melody generation, but models trained with Supervised Fine-Tuning (SFT) often produce musically implausible melodies with issues like poor rhythm and unsuitable vocal ranges, a…

Sound · Computer Science 2026-04-21 Hao Meng , Siyuan Zheng , Shuran Zhou , Qiangqiang Wang , Yang Song

A song is a combination of singing voice and accompaniment. However, existing works focus on singing voice synthesis and music generation independently. Little attention was paid to explore song synthesis. In this work, we propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Zhiqing Hong , Rongjie Huang , Xize Cheng , Yongqi Wang , Ruiqi Li , Fuming You , Zhou Zhao , Zhimeng Zhang
‹ Prev 1 2 3 10 Next ›