English
Related papers

Related papers: The Interpretation Gap in Text-to-Music Generation…

200 papers

There is an increasing interest from ML and HCI communities in empowering creators with better generative models and more intuitive interfaces with which to control them. In music, ML researchers have focused on training models capable of…

Human-Computer Interaction · Computer Science 2021-12-01 Ryan Louie , Jesse Engel , Anna Huang

Text-to-music generation models are now capable of generating high-quality music audio in broad styles. However, text control is primarily suitable for the manipulation of global musical attributes like genre, mood, and tempo, and is less…

Sound · Computer Science 2023-11-14 Shih-Lun Wu , Chris Donahue , Shinji Watanabe , Nicholas J. Bryan

Despite progress in melody-to-lyric generation, a substantial singability gap remains between machine-generated lyrics and those written by human lyricists. In this work, we aim to narrow this gap by jointly learning both wording and…

Computation and Language · Computer Science 2025-12-15 Longshen Ou , Xichu Ma , Ye Wang

Song generation is regarded as the most challenging problem in music AIGC; nonetheless, existing approaches have yet to fully overcome four persistent limitations: controllability, generalizability, perceptual quality, and duration. We…

Sound · Computer Science 2025-08-05 Tongxi Wang , Yang Yu , Qing Wang , Junlang Qian

AI systems for high quality music generation typically rely on extremely large musical datasets to train the AI models. This creates barriers to generating music beyond the genres represented in dominant datasets such as Western Classical…

Sound · Computer Science 2024-07-19 Nick Bryan-Kinns , Zijin Li

Music generation introduces challenging complexities to large language models. Symbolic structures of music often include vertical harmonization as well as horizontal counterpoint, urging various adaptations and enhancements for large-scale…

Sound · Computer Science 2024-07-30 Seungyeon Rhyu , Kichang Yang , Sungjun Cho , Jaehyeon Kim , Kyogu Lee , Moontae Lee

We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transformer-based framework…

Artificial Intelligence · Computer Science 2022-02-14 Rui Guo , Ivor Simpson , Chris Kiefer , Thor Magnusson , Dorien Herremans

Recent advances in text-to-music (TTM) generation have enabled controllable and expressive music creation using natural language prompts. However, the emotional fidelity of TTM systems remains largely underexplored compared to human…

Sound · Computer Science 2025-09-05 Gyehun Go , Satbyul Han , Ahyeon Choi , Eunjin Choi , Juhan Nam , Jeong Mi Park

While many topics of the learning-based approach to automated music generation are under active research, musical form is under-researched. In particular, recent methods based on deep learning models generate music that, at the largest time…

Sound · Computer Science 2024-04-19 Lilac Atassi

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic…

Sound · Computer Science 2021-09-08 Carlos Hernandez-Olivan , Jose R. Beltran

AI music generation is rapidly emerging in the creative industries, enabling intuitive music generation from textual descriptions. However, these systems pose risks in exploitation of copyrighted creations, raising ethical and legal…

Computation and Language · Computer Science 2025-09-25 Jinju Kim , Taehan Kim , Abdul Waheed , Jong Hwan , Rita Singh

This study presents an exploratory evaluation of Music Generation Systems (MGS) within contemporary music production workflows by examining eight open-source systems. The evaluation framework combines technical insights with practical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Shayan Dadman , Bernt Arild Bremdal , Andreas Bergsland

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ran Galun , Sagie Benaim

With rapid advances in generative artificial intelligence, the text-to-music synthesis task has emerged as a promising direction for music generation. Nevertheless, achieving precise control over multi-track generation remains an open…

Sound · Computer Science 2024-12-18 Yao Yao , Peike Li , Boyu Chen , Alex Wang

State-of-the art Text-To-Music (TTM) generative AI models are large and require desktop or server class compute, making them infeasible for deployment on mobile phones. This paper presents an analysis of trade-offs between model compression…

The rapid development of musical AI technologies has expanded the creative potential of various musical activities, ranging from music style transformation to music generation. However, little research has investigated how musical AIs can…

Human-Computer Interaction · Computer Science 2024-04-16 Jingjing Sun , Jingyi Yang , Guyue Zhou , Yucheng Jin , Jiangtao Gong

Recent advances in generative AI music have resulted in new technologies that are being framed as co-creative tools for musicians with early work demonstrating their potential to add to music practice. While the field has seen many valuable…

Human-Computer Interaction · Computer Science 2025-02-14 Stephen James Krol , Maria Teresa Llano Rodriguez , Miguel Loor Paredes

The subjective evaluation of music generation techniques has been mostly done with questionnaire-based listening tests while ignoring the perspectives from music composition, arrangement, and soundtrack editing. In this paper, we propose an…

Sound · Computer Science 2021-10-26 Wei-Tsung Lu , Meng-Hsuan Wu , Yuh-Ming Chiu , Li Su

In recent years, the burgeoning interest in diffusion models has led to significant advances in image and speech generation. Nevertheless, the direct synthesis of music waveforms from unrestricted textual prompts remains a relatively…

Sound · Computer Science 2023-09-22 Pengfei Zhu , Chao Pang , Yekun Chai , Lei Li , Shuohuan Wang , Yu Sun , Hao Tian , Hua Wu

While recent generative models can produce engaging music, their utility is limited. The variation in the music is often left to chance, resulting in compositions that lack structure. Pieces extending beyond a minute can become incoherent…

Sound · Computer Science 2023-11-01 Lilac Atassi