English
Related papers

Related papers: TeleMelody: Lyric-to-Melody Generation with a Temp…

200 papers

Creating a pop song melody according to pre-written lyrics is a typical practice for composers. A computational model of how lyrics are set as melodies is important for automatic composition systems, but an end-to-end lyric-to-melody model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-05 Daiyu Zhang , Ju-Chiang Wang , Katerina Kosta , Jordan B. L. Smith , Shicen Zhou

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challenges: 1) lyric-melody…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Jiaxing Yu , Xinda Wu , Yunfei Xu , Tieyao Zhang , Songruoyao Wu , Le Ma , Kejun Zhang

Automatic song writing is a topic of significant practical interest. However, its research is largely hindered by the lack of training data due to copyright concerns and challenged by its creative nature. Most noticeably, prior works often…

Lyrics-to-melody generation is an interesting and challenging topic in AI music research field. Due to the difficulty of learning the correlations between lyrics and melody, previous methods suffer from low generation quality and lack of…

Sound · Computer Science 2023-06-06 Zhe Zhang , Yi Yu , Atsuhiro Takasu

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

Lyric-to-melody generation is an important task in songwriting, and is also quite challenging due to its unique characteristics: the generated melodies should not only follow good musical patterns, but also align with features in lyrics…

Sound · Computer Science 2023-01-31 Ang Lv , Xu Tan , Tao Qin , Tie-Yan Liu , Rui Yan

Despite progress in melody-to-lyric generation, a substantial singability gap remains between machine-generated lyrics and those written by human lyricists. In this work, we aim to narrow this gap by jointly learning both wording and…

Computation and Language · Computer Science 2025-12-15 Longshen Ou , Xichu Ma , Ye Wang

Music that is generated by recurrent neural networks often lacks a sense of direction and coherence. We therefore propose a two-stage LSTM-based model for lead sheet generation, in which the harmonic and rhythmic templates of the song are…

Sound · Computer Science 2020-02-25 Cedric De Boom , Stephanie Van Laere , Tim Verbelen , Bart Dhoedt

Automatic song writing aims to compose a song (lyric and/or melody) by machine, which is an interesting topic in both academia and industry. In automatic song writing, lyric-to-melody generation and melody-to-lyric generation are two…

Sound · Computer Science 2020-12-10 Zhonghao Sheng , Kaitao Song , Xu Tan , Yi Ren , Wei Ye , Shikun Zhang , Tao Qin

In this paper, we propose a technique to address the most challenging aspect of algorithmic songwriting process, which enables the human community to discover original lyrics, and melodies suitable for the generated lyrics. The proposed…

Sound · Computer Science 2020-11-13 Gurunath Reddy Madhumani , Yi Yu , Florian Harscoët , Simon Canales , Suhua Tang

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alignment between the…

Computation and Language · Computer Science 2018-09-13 Hangbo Bao , Shaohan Huang , Furu Wei , Lei Cui , Yu Wu , Chuanqi Tan , Songhao Piao , Ming Zhou

A song is a combination of singing voice and accompaniment. However, existing works focus on singing voice synthesis and music generation independently. Little attention was paid to explore song synthesis. In this work, we propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Zhiqing Hong , Rongjie Huang , Xize Cheng , Yongqi Wang , Ruiqi Li , Fuming You , Zhou Zhao , Zhimeng Zhang

Text-to-song (TTSong) is a music generation task that synthesizes accompanied singing voices. Current TTSong methods, inherited from singing voice synthesis (SVS), require melody-related information that can sometimes be impractical, such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-03 Ruiqi Li , Zhiqing Hong , Yongqi Wang , Lichao Zhang , Rongjie Huang , Siqi Zheng , Zhou Zhao

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at…

Computation and Language · Computer Science 2024-01-31 Zhe Zhang , Karol Lasocki , Yi Yu , Atsuhiro Takasu

Although lyrics generation has achieved significant progress in recent years, it has limited practical applications because the generated lyrics cannot be performed without composing compatible melodies. In this work, we bridge this…

Computation and Language · Computer Science 2023-05-29 Yusen Sun , Liangyou Li , Qun Liu , Dit-Yan Yeung

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despite achievements in…

Sound · Computer Science 2025-06-03 Shuangrui Ding , Zihan Liu , Xiaoyi Dong , Pan Zhang , Rui Qian , Junhao Huang , Conghui He , Dahua Lin , Jiaqi Wang

We contribute a pop-song automation framework for lead melody generation and accompaniment arrangement. The framework reflects the major procedures of human music composition, generating both lead melody and piano accompaniment by a unified…

Sound · Computer Science 2018-12-31 Ziyu Wang , Gus Xia

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg
‹ Prev 1 2 3 10 Next ›