English
Related papers

Related papers: Aligning Text-to-Music Evaluation with Human Prefe…

200 papers

Evaluating generative models remains a fundamental challenge, particularly when the goal is to reflect human preferences. In this paper, we use music generation as a case study to investigate the gap between automatic evaluation metrics and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Huan Zhang , Jinhua Liang , Huy Phan , Wenwu Wang , Emmanouil Benetos

We propose the Fr\'echet Audio Distance (FAD), a novel, reference-free evaluation metric for music enhancement algorithms. We demonstrate how typical evaluation metrics for speech enhancement and blind source separation can fail to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-01-18 Kevin Kilgour , Mauricio Zuluaga , Dominik Roblek , Matthew Sharifi

The growing popularity of generative music models underlines the need for perceptually relevant, objective music quality metrics. The Frechet Audio Distance (FAD) is commonly used for this purpose even though its correlation with perceptual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-07 Azalea Gui , Hannes Gamper , Sebastian Braun , Dimitra Emmanouilidou

Although being widely adopted for evaluating generated audio signals, the Fr\'echet Audio Distance (FAD) suffers from significant limitations, including reliance on Gaussian assumptions, sensitivity to sample size, and high computational…

Sound · Computer Science 2025-03-11 Yoonjin Chung , Pilsun Eu , Junwon Lee , Keunwoo Choi , Juhan Nam , Ben Sangbae Chon

Evaluating text-to-image and text-to-video models is challenging due to a fundamental disconnect: established metrics fail to jointly measure visual quality and semantic alignment with text, leading to a poor correlation with human…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jaywon Koo , Jefferson Hernandez , Moayed Haji-Ali , Ziyan Yang , Vicente Ordonez

In this paper we introduce the Frechet Music Distance (FMD), a novel evaluation metric for generative symbolic music models, inspired by the Frechet Inception Distance (FID) in computer vision and Frechet Audio Distance (FAD) in generative…

Sound · Computer Science 2025-01-17 Jan Retkowski , Jakub Stępniak , Mateusz Modrzejewski

This paper explores whether considering alternative domain-specific embeddings to calculate the Fr\'echet Audio Distance (FAD) metric can help the FAD to correlate better with perceptual ratings of environmental sounds. We used embeddings…

An increasing number of generative music models can be conditioned on an audio prompt that serves as musical context for which the model is to create an accompaniment (often further specified using a text prompt). Evaluation of how well…

Sound · Computer Science 2024-12-31 Maarten Grachten

Recent advancements have brought generated music closer to human-created compositions, yet evaluating these models remains challenging. While human preference is the gold standard for assessing quality, translating these subjective…

Machine Learning · Computer Science 2025-06-25 Florian Grötschla , Ahmet Solak , Luca A. Lanzendörfer , Roger Wattenhofer

The complex nature of musical emotion introduces inherent bias in both recognition and generation, particularly when relying on a single audio encoder, emotion classifier, or evaluation metric. In this work, we conduct a study on Music…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Azalea Gui , Dimitra Emmanouilidou , Hannes Gamper

In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting. Motivated by recent advances in the computer vision domain, we are the first to explore the combination of pre-trained text-to-audio…

Fr\'echet Audio Distance (FAD) is the de facto standard for evaluating text-to-audio generation, yet its scores depend on the underlying encoder's embedding space. An encoder's training task dictates which acoustic features are preserved or…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-02 Wonwoo Jeong

We present Music Arena, an open platform for scalable human preference evaluation of text-to-music (TTM) models. Soliciting human preferences via listening studies is the gold standard for evaluation in TTM, but these studies are expensive…

As major progress is made in open-ended text generation, measuring how close machine-generated text is to human language remains a critical open problem. We introduce MAUVE, a comparison measure for open-ended text generation, which…

Computation and Language · Computer Science 2021-11-24 Krishna Pillutla , Swabha Swayamdipta , Rowan Zellers , John Thickstun , Sean Welleck , Yejin Choi , Zaid Harchaoui

The technology for generating music from textual descriptions has seen rapid advancements. However, evaluating text-to-music (TTM) systems remains a significant challenge, primarily due to the difficulty of balancing performance and cost…

Sound · Computer Science 2025-03-25 Cheng Liu , Hui Wang , Jinghua Zhao , Shiwan Zhao , Hui Bu , Xin Xu , Jiaming Zhou , Haoqin Sun , Yong Qin

Evaluation of musical source separation (MSS) has traditionally relied on Blind Source Separation Evaluation (BSS-Eval) metrics. However, recent work suggests that BSS-Eval metrics exhibit low correlation between metrics and perceptual…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-23 Paul A. Bereuter , Alois Sontacchi

This paper presents an overview and the technical framework of the ICME 2026 Grand Challenge on Academic Text-to-Music Generation (ATTM). Despite the rapid progress in text-to-music generation (TTM) systems, the field is currently dominated…

Sound · Computer Science 2026-05-22 Fang-Chih Hsieh , Wei-Jaw Lee , Chun-Ping Wang , Hung-yi Lee , Hao-Wen Dong , Yi-Hsuan Yang

Music source separation aims to extract individual sound sources (e.g., vocals, drums, guitar) from a mixed music recording. However, evaluating the quality of separated audio remains challenging, as commonly used metrics like the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-01 Noah Jaffe , John Ashley Burgoyne

Objective evaluation of synthetic speech quality remains a critical challenge. Human listening tests are the gold standard, but costly and impractical at scale. Fr\'echet Distance has emerged as a promising alternative, yet its reliability…

Sound · Computer Science 2026-01-30 June-Woo Kim , Dhruv Agarwal , Federica Cerina

Automatic Music Transcription (AMT) -- the task of converting music audio into note representations -- has seen rapid progress, driven largely by deep learning systems. Due to the limited availability of richly annotated music datasets,…

Sound · Computer Science 2026-01-27 Lukáš Samuel Marták , Patricia Hu , Gerhard Widmer
‹ Prev 1 2 3 10 Next ›