English
Related papers

Related papers: Benchmarking Music Generation Models and Metrics v…

200 papers

The present work is part of a research line seeking to uncover the mysteries of what lies behind people's musical preferences in order to provide better music recommendations. More specifically, it takes the angle of personal values.…

Multimedia · Computer Science 2023-02-21 Sandy Manolios , Catholijn M. Jonker , Cynthia C. S. Liem

Personalized recommendation on new track releases has always been a challenging problem in the music industry. To combat this problem, we first explore user listening history and demographics to construct a user embedding representing the…

Sound · Computer Science 2021-03-31 Ke Chen , Beici Liang , Xiaoshuan Ma , Minwei Gu

While music generation models have evolved to handle complex multimodal inputs mixing text, lyrics, and reference audio, evaluation mechanisms have lagged behind. In this paper, we bridge this critical gap by establishing a comprehensive…

We review human evaluation practices in automatic, speech-driven 3D gesture generation and find a lack of standardisation and frequent use of flawed experimental setups. This leads to a situation where it is impossible to know how different…

Deep learning models are typically evaluated to measure and compare their performance on a given task. The metrics that are commonly used to evaluate these models are standard metrics that are used for different tasks. In the field of music…

Sound · Computer Science 2022-04-05 Carlos Hernandez-Olivan , Jorge Abadias Puyuelo , Jose R. Beltran

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling of language nuances and context-specific variations leads…

Recommendation to groups of users is a challenging and currently only passingly studied task. Especially the evaluation aspect often appears ad-hoc and instead of truly evaluating on groups of users, synthesizes groups by merging individual…

Artificial Intelligence · Computer Science 2017-08-01 Zsolt Mezei , Carsten Eickhoff

In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting. Motivated by recent advances in the computer vision domain, we are the first to explore the combination of pre-trained text-to-audio…

The field of Automatic Music Generation has seen significant progress thanks to the advent of Deep Learning. However, most of these results have been produced by unconditional models, which lack the ability to interact with their users, not…

Sound · Computer Science 2022-12-22 Pedro Neves , Jose Fornari , João Florindo

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Justin Kilb , Caroline Ellis

Generative AI models have recently blossomed, significantly impacting artistic and musical traditions. Research investigating how humans interact with and deem these models is therefore crucial. Through a listening and reflection study, we…

Sound · Computer Science 2024-08-01 Pedro Sarmento , Jackson Loth , Mathieu Barthet

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic…

Sound · Computer Science 2021-09-08 Carlos Hernandez-Olivan , Jose R. Beltran

Generative AI systems have become ubiquitous for all kinds of modalities, which makes the issue of the evaluation of such models more pressing. One popular approach is preference ratings, where the generated outputs of different systems are…

Artificial Intelligence · Computer Science 2024-06-04 Pius von Däniken , Jan Deriu , Don Tuggener , Mark Cieliebak

NLP models have progressed drastically in recent years, according to numerous datasets proposed to evaluate performance. Questions remain, however, about how particular dataset design choices may impact the conclusions we draw about model…

Computation and Language · Computer Science 2023-10-27 Kaiser Sun , Adina Williams , Dieuwke Hupkes

Research on generative systems in music has seen considerable attention and growth in recent years. A variety of attempts have been made to systematically evaluate such systems. We present an interdisciplinary review of the common…

Sound · Computer Science 2025-09-23 Alexander Lerch , Claire Arthur , Nick Bryan-Kinns , Corey Ford , Qianyi Sun , Ashvala Vinay

Music popularity prediction has attracted growing research interest, with relevance to artists, platforms, and recommendation systems. However, the explosive rise of AI-generated music platforms has created an entirely new and largely…

Sound · Computer Science 2026-05-06 Jaavid Aktar Husain , Dorien Herremans

Music serves as a powerful reflection of individual identity, often aligning with deeper psychological traits. Prior research has established correlations between musical preferences and personality, while separate studies have demonstrated…

Computation and Language · Computer Science 2025-10-14 Eliran Shem-Tov , Ella Rabinovich

Generative models of expressive piano performance are usually assessed by comparing their predictions to a reference human performance. A generative algorithm is taken to be better than competing ones if it produces performances that are…

The technology for generating music from textual descriptions has seen rapid advancements. However, evaluating text-to-music (TTM) systems remains a significant challenge, primarily due to the difficulty of balancing performance and cost…

Sound · Computer Science 2025-03-25 Cheng Liu , Hui Wang , Jinghua Zhao , Shiwan Zhao , Hui Bu , Xin Xu , Jiaming Zhou , Haoqin Sun , Yong Qin

In recent years, machine learning models have rapidly become better at generating clinical consultation notes; yet, there is little work on how to properly evaluate the generated consultation notes to understand the impact they may have on…

Computation and Language · Computer Science 2022-04-04 Francesco Moramarco , Alex Papadopoulos Korfiatis , Mark Perera , Damir Juric , Jack Flann , Ehud Reiter , Anya Belz , Aleksandar Savkov