English
Related papers

Related papers: SongPrep: A Preprocessing Framework and End-to-end…

200 papers

The traditional songwriting process is rather complex and this is evident in the time it takes to produce lyrics that fit the genre and form comprehensive verses. Our project aims to simplify this process with deep learning techniques, thus…

Computation and Language · Computer Science 2024-09-24 Tracy Cai , Wilson Liang , Donte Townes

Lyric-to-melody generation aims to automatically create melodies based on given lyrics, requiring the capture of complex and subtle correlations between them. However, previous works usually suffer from two main challenges: 1) lyric-melody…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Jiaxing Yu , Xinda Wu , Yunfei Xu , Tieyao Zhang , Songruoyao Wu , Le Ma , Kejun Zhang

Cover songs constitute a vital aspect of musical culture, preserving the core melody of an original composition while reinterpreting it to infuse novel emotional depth and thematic emphasis. Although prior research has explored the…

Sound · Computer Science 2026-02-24 Sifei Li , Yang Li , Zizhou Wang , Yuxin Zhang , Fuzhang Wu , Oliver Deussen , Tong-Yee Lee , Weiming Dong

Text-to-song generation, the task of creating vocals and accompaniment from textual inputs, poses significant challenges due to domain complexity and data scarcity. Existing approaches often employ multi-stage generation procedures, leading…

Large language models have achieved significant success in various domains, yet their understanding of lyric-centric knowledge has not been fully explored. In this work, we first introduce PlaylistSense, a dataset to evaluate the playlist…

Computation and Language · Computer Science 2026-01-06 Jiani Guo , Jiajia Li , Jie Wu , Zuchao Li , Yujiu Yang , Ping Wang

Writing rap lyrics requires both creativity to construct a meaningful, interesting story and lyrical skills to produce complex rhyme patterns, which form the cornerstone of good flow. We present a rap lyrics generation method that captures…

Machine Learning · Computer Science 2016-06-13 Eric Malmi , Pyry Takala , Hannu Toivonen , Tapani Raiko , Aristides Gionis

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

The recent rise in capabilities of AI-based music generation tools has created an upheaval in the music industry, necessitating the creation of accurate methods to detect such AI-generated content. This can be done using audio-based…

The quantity of processed data is crucial for advancing the field of singing voice synthesis. While there are tools available for lyric or note transcription tasks, they all need pre-processed data which is relatively time-consuming (e.g.,…

Sound · Computer Science 2024-10-11 Siwei Wu , Jinzheng He , Ruibin Yuan , Haojie Wei , Xipin Wei , Chenghua Lin , Jin Xu , Junyang Lin

Automatic song writing aims to compose a song (lyric and/or melody) by machine, which is an interesting topic in both academia and industry. In automatic song writing, lyric-to-melody generation and melody-to-lyric generation are two…

Sound · Computer Science 2020-12-10 Zhonghao Sheng , Kaitao Song , Xu Tan , Yi Ren , Wei Ye , Shikun Zhang , Tao Qin

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…

In this paper, we propose a technique to address the most challenging aspect of algorithmic songwriting process, which enables the human community to discover original lyrics, and melodies suitable for the generated lyrics. The proposed…

Sound · Computer Science 2020-11-13 Gurunath Reddy Madhumani , Yi Yu , Florian Harscoët , Simon Canales , Suhua Tang

Lyrics generation presents unique challenges, particularly in achieving precise syllable control while adhering to song form structures such as verses and choruses. Conventional line-by-line approaches often lead to unnatural phrasing,…

Computation and Language · Computer Science 2025-06-24 Yunkee Chae , Eunsik Shin , Suntae Hwang , Seungryeol Paik , Kyogu Lee

Music is an integral part of human culture, embodying human intelligence and creativity, of which songs compose an essential part. While various aspects of song generation have been explored by previous works, such as singing voice, vocal…

Automatic song writing is a topic of significant practical interest. However, its research is largely hindered by the lack of training data due to copyright concerns and challenged by its creative nature. Most noticeably, prior works often…

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despite achievements in…

Sound · Computer Science 2025-06-03 Shuangrui Ding , Zihan Liu , Xiaoyi Dong , Pan Zhang , Rui Qian , Junhao Huang , Conghui He , Dahua Lin , Jiaqi Wang

There has recently been a sharp increase in interest in Artificial Intelligence-Generated Content (AIGC). Despite this, musical components such as time signatures have not been studied sufficiently to form an algorithmic determination…

Machine Learning · Computer Science 2025-07-10 Callie C. Liao , Duoduo Liao , Jesse Guessford

The Song Generation task aims to synthesize music composed of vocals and accompaniment from given lyrics. While the existing method, Jukebox, has explored this task, its constrained control over the generations often leads to deficiency in…

Sound · Computer Science 2024-09-11 Shuochen Gao , Shun Lei , Fan Zhuo , Hangyu Liu , Feng Liu , Boshi Tang , Qiaochu Huang , Shiyin Kang , Zhiyong Wu

Recent advancements in song generation have shown promising results in generating songs from lyrics and/or global text prompts. However, most existing systems lack the ability to model the temporally varying attributes of songs, limiting…

Sound · Computer Science 2026-05-29 Pengfei Cai , Joanna Wang , Haorui Zheng , Xu Li , Zihao Ji , Teng Ma , Zhongliang Liu , Chen Zhang , Pengfei Wan

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg
‹ Prev 1 2 3 10 Next ›