English
Related papers

Related papers: Unsupervised Melody-to-Lyric Generation

200 papers

Automatic lyrics generation has received attention from both music and AI communities for years. Early rule-based approaches have~---due to increases in computational power and evolution in data-driven models---~mostly been replaced with…

Sound · Computer Science 2020-10-29 Yihao Chen , Alexander Lerch

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

Although lyrics generation has achieved significant progress in recent years, it has limited practical applications because the generated lyrics cannot be performed without composing compatible melodies. In this work, we bridge this…

Computation and Language · Computer Science 2023-05-29 Yusen Sun , Liangyou Li , Qun Liu , Dit-Yan Yeung

Lyric-to-melody generation is an important task in songwriting, and is also quite challenging due to its unique characteristics: the generated melodies should not only follow good musical patterns, but also align with features in lyrics…

Sound · Computer Science 2023-01-31 Ang Lv , Xu Tan , Tao Qin , Tie-Yan Liu , Rui Yan

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

Generating melody from lyrics is an interesting yet challenging task in the area of artificial intelligence and music. However, the difficulty of keeping the consistency between input lyrics and generated melody limits the generation…

Sound · Computer Science 2022-07-06 Wei Duan , Zhe Zhang , Yi Yu , Keizo Oyama

We present the Melody-Guided Music Generation (MG2) model, a novel approach using melody to guide the text-to-music generation that, despite a simple method and limited resources, achieves excellent performance. Specifically, we first align…

Sound · Computer Science 2024-12-31 Shaopeng Wei , Manzhen Wei , Haoyu Wang , Yu Zhao , Gang Kou

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despite achievements in…

Sound · Computer Science 2025-06-03 Shuangrui Ding , Zihan Liu , Xiaoyi Dong , Pan Zhang , Rui Qian , Junhao Huang , Conghui He , Dahua Lin , Jiaqi Wang

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at…

Computation and Language · Computer Science 2024-01-31 Zhe Zhang , Karol Lasocki , Yi Yu , Atsuhiro Takasu

Generative models for singing voice have been mostly concerned with the task of ``singing voice synthesis,'' i.e., to produce singing voice waveforms given musical scores and text lyrics. In this work, we explore a novel yet challenging…

Sound · Computer Science 2020-07-22 Jen-Yu Liu , Yu-Hua Chen , Yin-Cheng Yeh , Yi-Hsuan Yang

In this paper, we comprehensively study on context-aware generation of Chinese song lyrics. Conventional text generative models generate a sequence or sentence word by word, failing to consider the contextual relationship between sentences.…

Computation and Language · Computer Science 2019-06-18 Haoshen Fan , Jie Wang , Bojin Zhuang , Shaojun Wang , Jing Xiao

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

This paper presents a novel, syllable-structured Chinese lyrics generation model given a piece of original melody. Most previously reported lyrics generation models fail to include the relationship between lyrics and melody. In this work,…

Computation and Language · Computer Science 2019-06-25 Xu Lu , Jie Wang , Bojin Zhuang , Shaojun Wang , Jing Xiao

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

In recent years, the use of large language models (LLMs) to generate music content, particularly lyrics, has gained in popularity. These advances provide valuable tools for artists and enhance their creative processes, but they also raise…

Computation and Language · Computer Science 2025-04-25 Yanis Labrak , Markus Frohmann , Gabriel Meseguer-Brocal , Elena V. Epure

Artificial Intelligence Generated Content (AIGC) is currently a popular research area. Among its various branches, song generation has attracted growing interest. Despite the abundance of available songs, effective data preparation remains…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-23 Wei Tan , Shun Lei , Huaicheng Zhang , Guangzheng Li , Yixuan Zhang , Hangting Chen , Jianwei Yu , Rongzhi Gu , Dong Yu

Music is an integral part of human culture, embodying human intelligence and creativity, of which songs compose an essential part. While various aspects of song generation have been explored by previous works, such as singing voice, vocal…

Recent years have seen many audio-domain text-to-music generation models that rely on large amounts of text-audio pairs for training. However, symbolic-domain controllable music generation has lagged behind partly due to the lack of a…

Sound · Computer Science 2025-06-17 Weihan Xu , Julian McAuley , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Hao-Wen Dong

Lyrics generation is a well-known application in natural language generation research, with several previous studies focusing on generating accurate lyrics using precise control such as keywords, rhymes, etc. However, lyrics imitation,…

Computation and Language · Computer Science 2023-10-10 Yongzhu Chang , Rongsheng Zhang , Lin Jiang , Qihang Chen , Le Zhang , Jiashu Pu

The Song Generation task aims to synthesize music composed of vocals and accompaniment from given lyrics. While the existing method, Jukebox, has explored this task, its constrained control over the generations often leads to deficiency in…

Sound · Computer Science 2024-09-11 Shuochen Gao , Shun Lei , Fan Zhuo , Hangyu Liu , Feng Liu , Boshi Tang , Qiaochu Huang , Shiyin Kang , Zhiyong Wu