English
Related papers

Related papers: MusicAIR: A Multimodal AI Music Generation Framewo…

200 papers

Enhancing the ability of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) to interpret sheet music is a crucial step toward building AI musicians. However, current research lacks both evaluation benchmarks and…

Computation and Language · Computer Science 2025-09-29 Zhilin Wang , Zhe Yang , Yun Luo , Yafu Li , Xiaoye Qu , Ziqian Qiao , Haoran Zhang , Runzhe Zhan , Derek F. Wong , Jizhe Zhou , Yu Cheng

Recent advances in generative models have sparked research on improving model fairness with AI-generated data. However, existing methods often face limitations in the diversity and quality of synthetic data, leading to compromised fairness…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zengqun Zhao , Ziquan Liu , Yu Cao , Shaogang Gong , Ioannis Patras

While generative AI systems have gained popularity in diverse applications, their potential to produce harmful outputs limits their trustworthiness and usability in different applications. Recent years have seen growing interest in engaging…

Human-Computer Interaction · Computer Science 2025-04-01 Matheus Kunzler Maldaner , Wesley Hanwen Deng , Jason Hong , Ken Holstein , Motahhare Eslami

We use Google's MusicVAE, a Variational Auto-Encoder with a 512-dimensional latent space to represent a few bars of music, and organize the latent dimensions according to their relevance in describing music. We find that, on average, most…

Sound · Computer Science 2023-08-02 Gabriela Barenboim , Luigi Del Debbio , Johannes Hirn , Veronica Sanz

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical…

Sound · Computer Science 2019-08-09 Jean-Pierre Briot , Gaëtan Hadjeres , François-David Pachet

As online communication continues to expand, participants often face cognitive fatigue and reduced engagement. Cognitive augmentation, which leverages technology to enhance human abilities, offers promising solutions to these challenges. In…

Human-Computer Interaction · Computer Science 2025-03-04 Haruki Suzawa , Ko Watanabe , Andreas Dengel , Shoya Ishimaru

Generative AI (GenAI) will have significant impact on content creation platforms. In this paper, we study the dynamic competition between a GenAI and a human contributor. Unlike the human, the GenAI's content only improves when more…

Computer Science and Game Theory · Computer Science 2025-03-11 Seyed A. Esmaeili , Kevin Lim , Kshipra Bhawalkar , Zhe Feng , Di Wang , Haifeng Xu

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic…

Sound · Computer Science 2021-09-08 Carlos Hernandez-Olivan , Jose R. Beltran

Detecting AI-generated music is crucial for preserving artistic authenticity and preventing the misuse of generative music technologies. However, existing discriminative detectors typically rely on generated samples during training and…

Sound · Computer Science 2026-05-19 Chaolei Han , Hongsong Wang , Jie Gui

Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally. A better understanding of music can enhance our emotions, cognitive skills, and cultural connections.…

Music arrangement generation is a subtask of automatic music generation, which involves reconstructing and re-conceptualizing a piece with new compositional techniques. Such a generation process inevitably requires reference from the…

Sound · Computer Science 2020-08-18 Ziyu Wang , Ke Chen , Junyan Jiang , Yiyi Zhang , Maoran Xu , Shuqi Dai , Xianbin Gu , Gus Xia

Diffusion and flow-matching models have revolutionized automatic text-to-audio generation in recent times. These models are increasingly capable of generating high quality and faithful audio outputs capturing to speech and acoustic events.…

AI-driven content creation has shown potential in film production. However, existing film generation systems struggle to implement cinematic principles and thus fail to generate professional-quality films, particularly lacking diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Kaiyi Huang , Yukun Huang , Xintao Wang , Zinan Lin , Xuefei Ning , Pengfei Wan , Di Zhang , Yu Wang , Xihui Liu

One of the challenging problems in Music Information Retrieval is the acquisition of enough non-copyrighted audio recordings for model training and evaluation. This study compares two Transformer-based neural network models for chord…

Sound · Computer Science 2025-08-11 Martyna Majchrzak , Jacek Mańdziuk

Adolescence is marked by strong creative impulses but limited strategies for structured expression, often leading to frustration or disengagement. While generative AI lowers technical barriers and delivers efficient outputs, its role in…

Human-Computer Interaction · Computer Science 2025-09-15 Zhejing Hu , Yan Liu , Zhi Zhang , Gong Chen , Bruce X. B. Yu , Junxian Li , Jiannong Cao

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Justin Kilb , Caroline Ellis

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

Generative AI presents a profound challenge to traditional notions of human uniqueness, particularly in creativity. Fueled by neural network based foundation models, these systems demonstrate remarkable content generation capabilities,…

Artificial Intelligence · Computer Science 2025-04-11 Jordi Linares-Pellicer , Juan Izquierdo-Domenech , Isabel Ferri-Molla , Carlos Aliaga-Torro

Online AI platforms for creating music from text prompts (AI music), such as Suno and Udio, are now being used by hundreds of thousands of users. Some AI music is appearing in advertising, and even charting, in multiple countries. How are…

Information Retrieval · Computer Science 2025-09-16 Luca Casini , Laura Cros Vila , David Dalmazzo , Anna-Kaisa Kaila , Bob L. T. Sturm