English
Related papers

Related papers: A framework to compare music generative models usi…

200 papers

Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody. It is of significant practical interest and more challenging than unconstrained lyric generation as the music imposes additional…

Generating music medleys is about finding an optimal permutation of a given set of music clips. Toward this goal, we propose a self-supervised learning task, called the music puzzle game, to train neural network models to learn the…

Machine Learning · Statistics 2017-11-20 Yu-Siang Huang , Szu-Yu Chou , Yi-Hsuan Yang

Creating a complex work of art like music necessitates profound creativity. With recent advancements in deep learning and powerful models such as transformers, there has been huge progress in automatic music generation. In an accompaniment…

Sound · Computer Science 2022-09-02 Rishabh Dahale , Vaibhav Talwadker , Preeti Rao , Prateek Verma

Music is inherently made up of complex structures, and representing them as graphs helps to capture multiple levels of relationships. While music generation has been explored using various deep generation techniques, research on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Wen Qing Lim , Jinhua Liang , Huan Zhang

One of the challenging problems in Music Information Retrieval is the acquisition of enough non-copyrighted audio recordings for model training and evaluation. This study compares two Transformer-based neural network models for chord…

Sound · Computer Science 2025-08-11 Martyna Majchrzak , Jacek Mańdziuk

Many practices have been presented in music generation recently. While stylistic music generation using deep learning techniques has became the main stream, these models still struggle to generate music with high musicality, different…

Sound · Computer Science 2021-05-12 Shuqi Dai , Xichu Ma , Ye Wang , Roger B. Dannenberg

We tackle the task of conditional music generation. We introduce MusicGen, a single Language Model (LM) that operates over several streams of compressed discrete music representation, i.e., tokens. Unlike prior work, MusicGen is comprised…

Music producers who use loops may have access to thousands in loop libraries, but finding ones that are compatible is a time-consuming process; we hope to reduce this burden with automation. State-of-the-art systems for estimating…

Sound · Computer Science 2022-02-18 Bo-Yu Chen , Jordan B. L. Smith , Yi-Hsuan Yang

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

Text-image generation has advanced rapidly, but assessing whether outputs truly capture the objects, attributes, and relations described in prompts remains a central challenge. Evaluation in this space relies heavily on automated metrics,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Seyed Amir Kasaei , Ali Aghayari , Arash Marioriyad , Niki Sepasian , MohammadAmin Fazli , Mahdieh Soleymani Baghshah , Mohammad Hossein Rohban

Pitch and meter are two fundamental music features for symbolic music generation tasks, where researchers usually choose different encoding methods depending on specific goals. However, the advantages and drawbacks of different encoding…

Sound · Computer Science 2023-02-01 Yuqiang Li , Shengchen Li , George Fazekas

While Large Language Models (LLMs) make symbolic music generation increasingly accessible, producing music with distinctive composition and rich expressiveness remains a significant challenge. Many studies have introduced emotion models to…

Sound · Computer Science 2025-11-19 Dengyun Huang , Yonghua Zhu

Despite recent achievements of deep learning automatic music generation algorithms, few approaches have been proposed to evaluate whether a single-track music excerpt is composed by automatons or Homo sapiens. To tackle this problem, we…

Sound · Computer Science 2021-02-02 Mingshuo Ding , Yinghao Ma

Creating aesthetically pleasing pieces of art, including music, has been a long-term goal for artificial intelligence research. Despite recent successes of long-short term memory (LSTM) recurrent neural networks (RNNs) in sequential…

Machine Learning · Computer Science 2019-03-25 Zheng Sun , Jiaqi Liu , Zewang Zhang , Jingwen Chen , Zhao Huo , Ching Hua Lee , Xiao Zhang

Our work revisits the design of mechanisms via the learning-augmented framework. In this model, the algorithm is enhanced with imperfect (machine-learned) information concerning the input, usually referred to as prediction. The goal is to…

Computer Science and Game Theory · Computer Science 2024-10-29 George Christodoulou , Alkmini Sgouritsa , Ioannis Vlachos

Generating music has a few notable differences from generating images and videos. First, music is an art of time, necessitating a temporal model. Second, music is usually composed of multiple instruments/tracks with their own temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-06 Hao-Wen Dong , Wen-Yi Hsiao , Li-Chia Yang , Yi-Hsuan Yang

The development of generative artificial intelligence for human motion generation has expanded rapidly, necessitating a unified evaluation framework. This paper presents a detailed review of eight evaluation metrics for human motion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

We use a modified SampleRNN architecture to generate music in modern genres such as black metal and math rock. Unlike MIDI and symbolic models, SampleRNN generates raw audio in the time domain. This requirement becomes increasingly…

Sound · Computer Science 2018-11-19 Zack Zukowski , CJ Carr

We evaluated various compositional models, from bag-of-words representations to compositional RNN-based models, on several extrinsic supervised and unsupervised evaluation benchmarks. Our results confirm that weighted vector averaging can…

Computation and Language · Computer Science 2018-11-30 Hanan Aldarmaki , Mona Diab

In the realm of music AI, arranging rich and structured multi-track accompaniments from a simple lead sheet presents significant challenges. Such challenges include maintaining track cohesion, ensuring long-term coherence, and optimizing…

Sound · Computer Science 2024-11-26 Jingwei Zhao , Gus Xia , Ziyu Wang , Ye Wang