English
Related papers

Related papers: Conditional LSTM-GAN for Melody Generation from Ly…

200 papers

Automatic lyrics generation has received attention from both music and AI communities for years. Early rule-based approaches have~---due to increases in computational power and evolution in data-driven models---~mostly been replaced with…

Sound · Computer Science 2020-10-29 Yihao Chen , Alexander Lerch

Generating melody from lyrics is an interesting yet challenging task in the area of artificial intelligence and music. However, the difficulty of keeping the consistency between input lyrics and generated melody limits the generation…

Sound · Computer Science 2022-07-06 Wei Duan , Zhe Zhang , Yi Yu , Keizo Oyama

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challenges: 1) lyric-melody…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Jiaxing Yu , Xinda Wu , Yunfei Xu , Tieyao Zhang , Songruoyao Wu , Le Ma , Kejun Zhang

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

Lyrics-to-melody generation is an interesting and challenging topic in AI music research field. Due to the difficulty of learning the correlations between lyrics and melody, previous methods suffer from low generation quality and lack of…

Sound · Computer Science 2023-06-06 Zhe Zhang , Yi Yu , Atsuhiro Takasu

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and semantic patterns at…

Computation and Language · Computer Science 2024-01-31 Zhe Zhang , Karol Lasocki , Yi Yu , Atsuhiro Takasu

We propose a deep attention-based alignment network, which aims to automatically predict lyrics and melody with given incomplete lyrics as input in a way similar to the music creation of humans. Most importantly, a deep neural…

Sound · Computer Science 2023-01-25 Gurunath Reddy M , Zhe Zhang , Yi Yu , Florian Harscoet , Simon Canales , Suhua Tang

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

The connection between music and lyrics is far beyond semantic bonds. Conceptual pairs in the two modalities such as rhythm and rhyme, note duration and syllabic stress, and structure correspondence, raise a compelling yet seldom-explored…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-04 Changhong Wang , Michel Olvera , Gaël Richard

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…

Large Language Models (LLMs) show promise in lyric-to-melody generation, but models trained with Supervised Fine-Tuning (SFT) often produce musically implausible melodies with issues like poor rhythm and unsuitable vocal ranges, a…

Sound · Computer Science 2026-04-21 Hao Meng , Siyuan Zheng , Shuran Zhou , Qiangqiang Wang , Yang Song

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alignment between the…

Computation and Language · Computer Science 2018-09-13 Hangbo Bao , Shaohan Huang , Furu Wei , Lei Cui , Yu Wu , Chuanqi Tan , Songhao Piao , Ming Zhou

In recent years, the use of large language models (LLMs) to generate music content, particularly lyrics, has gained in popularity. These advances provide valuable tools for artists and enhance their creative processes, but they also raise…

Computation and Language · Computer Science 2025-04-25 Yanis Labrak , Markus Frohmann , Gabriel Meseguer-Brocal , Elena V. Epure

Automatic song writing is a topic of significant practical interest. However, its research is largely hindered by the lack of training data due to copyright concerns and challenged by its creative nature. Most noticeably, prior works often…

Over the past several years, deep learning for sequence modeling has grown in popularity. To achieve this goal, LSTM network structures have proven to be very useful for making predictions for the next output in a series. For instance, a…

Sound · Computer Science 2022-03-24 Michael Conner , Lucas Gral , Kevin Adams , David Hunger , Reagan Strelow , Alexander Neuwirth

Despite progress in melody-to-lyric generation, a substantial singability gap remains between machine-generated lyrics and those written by human lyricists. In this work, we aim to narrow this gap by jointly learning both wording and…

Computation and Language · Computer Science 2025-12-15 Longshen Ou , Xichu Ma , Ye Wang

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

The traditional songwriting process is rather complex and this is evident in the time it takes to produce lyrics that fit the genre and form comprehensive verses. Our project aims to simplify this process with deep learning techniques, thus…

Computation and Language · Computer Science 2024-09-24 Tracy Cai , Wilson Liang , Donte Townes

Music Generation (MG) is an interesting research topic that links the art of music and Artificial Intelligence (AI). The goal is to train an artificial composer to generate infinite, fresh, and pleasurable musical pieces. Music has…

Sound · Computer Science 2020-04-10 Majid Farzaneh , Rahil Mahdian Toroghi

This paper presents a novel, syllable-structured Chinese lyrics generation model given a piece of original melody. Most previously reported lyrics generation models fail to include the relationship between lyrics and melody. In this work,…

Computation and Language · Computer Science 2019-06-25 Xu Lu , Jie Wang , Bojin Zhuang , Shaojun Wang , Jing Xiao
‹ Prev 1 2 3 10 Next ›