English
Related papers

Related papers: Aligning Text-to-Music Evaluation with Human Prefe…

200 papers

Recent years have seen considerable advances in audio synthesis with deep generative models. However, the state-of-the-art is very difficult to quantify; different studies often use different evaluation methodologies and different metrics…

Sound · Computer Science 2022-09-02 Ashvala Vinay , Alexander Lerch

The Fr\'echet Video Distance (FVD) is a widely adopted metric for evaluating video generation distribution quality. However, its effectiveness relies on critical assumptions. Our analysis reveals three significant limitations: (1) the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ge Ya Luo , Gian Mario Favero , Zhi Hao Luo , Alexia Jolicoeur-Martineau , Christopher Pal

This study presents a machine learning framework for assessing similarity between audio content and predicting sentiment score. We construct a dataset containing audio samples from music covers on YouTube along with the audio of the…

Sound · Computer Science 2024-11-04 Aris J. Aristorenas

Determining whether two sets of images belong to the same or different distributions or domains is a crucial task in modern medical image analysis and deep learning; for example, to evaluate the output quality of image generative models.…

Music emotion recognition (MER), a sub-task of music information retrieval (MIR), has developed rapidly in recent years. However, the learning of affect-salient features remains a challenge. In this paper, we propose an end-to-end…

Sound · Computer Science 2022-07-01 Zi Huang , Shulei Ji , Zhilan Hu , Chuangjian Cai , Jing Luo , Xinyu Yang

Music representation learning is central to music information retrieval and generation. While recent advances in multimodal learning have improved alignment between text and audio for tasks such as cross-modal music retrieval, text-to-music…

Modern embedding-based metrics for evaluation of generated text generally fall into one of two paradigms: discriminative metrics that are trained to directly predict which outputs are of higher quality according to supervised human…

Computation and Language · Computer Science 2022-12-13 Yiwei Qin , Weizhe Yuan , Graham Neubig , Pengfei Liu

The Music Emotion Recognition (MER) field has seen steady developments in recent years, with contributions from feature engineering, machine learning, and deep learning. The landscape has also shifted from audio-centric systems to bimodal…

Over the years, Music Information Retrieval (MIR) research community has released various models pretrained on large amounts of music data. Transfer learning showcases the proven effectiveness of pretrained backend models for a broad…

Information Retrieval · Computer Science 2026-04-28 Yan-Martin Tamm , Anna Aljanaki

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

We present Manifold Alignment Determination (MAD), an algorithm for learning alignments between data points from multiple views or modalities. The approach is capable of learning correspondences between views as well as correspondences…

Machine Learning · Statistics 2017-01-13 Andreas Damianou , Neil D. Lawrence , Carl Henrik Ek

Fr\'echet Video Distance (FVD), a prominent metric for evaluating video generation models, is known to conflict with human perception occasionally. In this paper, we aim to explore the extent of FVD's bias toward per-frame quality over…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Songwei Ge , Aniruddha Mahapatra , Gaurav Parmar , Jun-Yan Zhu , Jia-Bin Huang

Machine Translation (MT) Quality Estimation (QE) assesses translation reliability without reference texts. This study introduces "textual similarity" as a new metric for QE, using sentence transformers and cosine similarity to measure…

Computation and Language · Computer Science 2024-07-02 Kun Sun , Rong Wang

Collecting large, aligned cross-modal datasets for music-flavor research is difficult because perceptual experiments are costly and small by design. We address this bottleneck through two complementary experiments. The first tests whether…

Sound · Computer Science 2026-04-14 Matteo Spanio , Valentina Frezzato , Antonio Rodà

A key challenge in MT evaluation is the inherent noise and inconsistency of human ratings. Regression-based neural metrics struggle with this noise, while prompting LLMs shows promise at system-level evaluation but performs poorly at…

Computation and Language · Computer Science 2025-04-21 Shaomu Tan , Christof Monz

While audio quality is a key performance metric for various audio processing tasks, including generative modeling, its objective measurement remains a challenge. Audio-Language Models (ALMs) are pre-trained on audio-text pairs that may…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-02 Soham Deshmukh , Dareen Alharthi , Benjamin Elizalde , Hannes Gamper , Mahmoud Al Ismail , Rita Singh , Bhiksha Raj , Huaming Wang

Metric learning projects samples into an embedded space, where similarities and dissimilarities are quantified based on their learned representations. However, existing methods often rely on label-guided representation learning, where…

Sound · Computer Science 2025-01-17 Donghuo Zeng , Kazushi Ikeda

In this paper, we introduce a psychology-inspired approach to model and predict the music genre preferences of different groups of users by utilizing human memory processes. These processes describe how humans access information units in…

Information Retrieval · Computer Science 2024-02-16 Dominik Kowald , Elisabeth Lex , Markus Schedl

Variational Autoencoders (VAEs) have proven to be effective models for producing latent representations of cognitive and semantic value. We assess the degree to which VAEs trained on a prototypical tonal music corpus of 371 Bach's chorales…

Sound · Computer Science 2023-11-08 Nádia Carvalho , Gilberto Bernardes

Recent text-guided image editing (TIE) models have achieved remarkable progress, while many edited images still suffer from issues such as artifacts, unexpected editings, unaesthetic contents. Although some benchmarks and methods have been…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zitong Xu , Huiyu Duan , Zhongpeng Ji , Xinyun Zhang , Yutao Liu , Xiongkuo Min , Ke Gu , Jian Zhang , Shusong Xu , Jinwei Chen , Bo Li , Guangtao Zhai