English
Related papers

Related papers: Aligning Generative Music AI with Human Preference…

200 papers

Aligning agent behaviors with diverse human preferences remains a challenging problem in reinforcement learning (RL), owing to the inherent abstractness and mutability of human preferences. To address these issues, we propose AlignDiff, a…

Artificial Intelligence · Computer Science 2024-02-06 Zibin Dong , Yifu Yuan , Jianye Hao , Fei Ni , Yao Mu , Yan Zheng , Yujing Hu , Tangjie Lv , Changjie Fan , Zhipeng Hu

Models of human feedback for AI alignment, such as those underpinning Direct Preference Optimization (DPO), often bake in a singular, static set of preferences, limiting adaptability. This paper challenges the assumption of monolithic…

Computation and Language · Computer Science 2025-06-16 Víctor Gallego

Music is a powerful medium for altering the emotional state of the listener. In recent years, with significant advancement in computing capabilities, artificial intelligence-based (AI-based) approaches have become popular for creating…

Human-Computer Interaction · Computer Science 2023-01-18 Adyasha Dash , Kat R. Agres

To achieve successful deployment of AI research, it is crucial to understand the demands of the industry. In this paper, we present the results of a survey conducted with professional audio engineers, in order to determine research…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-11 Sangshin Oh , Minsung Kang , Hyeongi Moon , Keunwoo Choi , Ben Sangbae Chon

This paper introduces four different artificial intelligence algorithms for music generation and aims to compare these methods not only based on the aesthetic quality of the generated music but also on their suitability for specific…

Sound · Computer Science 2025-04-04 Razvan Paroiu , Stefan Trausan-Matu

Artificial Intelligence (AI) for music generation is undergoing rapid developments, with recent symbolic models leveraging sophisticated deep learning and diffusion model algorithms. One drawback with existing models is that they lack…

Sound · Computer Science 2025-10-14 Stephen Ni-Hahn , Chao Péter Yang , Mingchen Ma , Cynthia Rudin , Simon Mak , Yue Jiang

User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Wenyi Mo , Ying Ba , Tianyu Zhang , Yalong Bai , Biye Li

This paper investigates the importance of personal ownership in musical AI design, examining how practising musicians can maintain creative control over the compositional process. Through a four-week ecological evaluation, we examined how a…

Human-Computer Interaction · Computer Science 2025-10-08 Stephen James Krol , Maria Teresa Llano , Jon McCormack

With the rapid advancement of Large Language Models (LLMs), AI-driven music generation has become a vibrant and fruitful area of research. However, the representation of musical data remains a significant challenge. To address this, a…

Machine Learning · Computer Science 2025-09-16 Cheng-Yang Tsai , Tzu-Wei Huang , Shao-Yu Wei , Guan-Wei Chen , Hung-Ying Chu , Yu-Cheng Lin

Recent advances in text-to-music editing, which employ text queries to modify music (e.g.\ by changing its style or adjusting instrumental components), present unique challenges and opportunities for AI-assisted music creation. Previous…

As large language models (LLMs) advance their capabilities, aligning these models with human preferences has become crucial. Preference optimization, which trains models to distinguish between preferred and non-preferred responses based on…

Machine Learning · Computer Science 2026-02-02 Shawn Im , Sharon Li

Preference-based reinforcement learning (PbRL) is the dominant framework for aligning AI systems to human preferences. However, evaluation protocols for such data were designed for text and have not been validated for speech. We present the…

Sound · Computer Science 2026-05-08 Aaron Broukhim , Nadir Weibel , Eshin Jolly

Music popularity prediction has attracted growing research interest, with relevance to artists, platforms, and recommendation systems. However, the explosive rise of AI-generated music platforms has created an entirely new and largely…

Sound · Computer Science 2026-05-06 Jaavid Aktar Husain , Dorien Herremans

Human decision makers increasingly delegate choices to AI agents, raising a natural question: does the AI implement the human principal's preferences or pursue its own? To study this question using revealed preference techniques, I…

Theoretical Economics · Economics 2026-03-31 Elchin Suleymanov

Many practices have been presented in music generation recently. While stylistic music generation using deep learning techniques has became the main stream, these models still struggle to generate music with high musicality, different…

Sound · Computer Science 2021-05-12 Shuqi Dai , Xichu Ma , Ye Wang , Roger B. Dannenberg

A key concern with the concept of "alignment" is the implicit question of "alignment to what?". AI systems are increasingly used across the world, yet safety alignment is often focused on homogeneous monolingual settings. Additionally,…

Computation and Language · Computer Science 2024-07-09 Aakanksha , Arash Ahmadian , Beyza Ermis , Seraphina Goldfarb-Tarrant , Julia Kreutzer , Marzieh Fadaee , Sara Hooker

Personalized alignment from preference data has focused primarily on improving personal reward model (RM) accuracy, with the implicit assumption that better preference ranking translates to better personalized behavior. However, in…

Artificial Intelligence · Computer Science 2026-01-09 Fady Rezk , Yuangang Pan , Chuan-Sheng Foo , Xun Xu , Nancy Chen , Henry Gouk , Timothy Hospedales

The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervised learning paradigms, recent large-scale generative models…

Generative AI is radically changing the creative arts, by fundamentally transforming the way we create and interact with cultural artefacts. While offering unprecedented opportunities for artistic expression and commercialisation, this…

Artificial Intelligence · Computer Science 2025-03-25 Jacopo de Berardinis , Lorenzo Porcaro , Albert Meroño-Peñuela , Angelo Cangelosi , Tess Buckley

Prevailing methods for assessing and comparing generative AIs incentivize responses that serve a hypothetical representative individual. Evaluating models in these terms presumes homogeneous preferences across the population and engenders…

Machine Learning · Computer Science 2023-03-06 Dilip Arumugam , Shi Dong , Benjamin Van Roy