English
Related papers

Related papers: Musical Agent Systems: MACAT and MACataRT

200 papers

As emergent artificial intelligence technologies increasingly assert roles as assistants within intangible cultural heritage contexts, researchers and artists observe existing questions on the theme of agency negotiation, cultural…

Human-Computer Interaction · Computer Science 2025-10-23 Joshua Nijiati Alimujiang

While AI presents significant potential for enhancing music mixing and mastering workflows, current research predominantly emphasizes end-to-end automation or generation, often overlooking the collaborative and instructional dimensions…

Sound · Computer Science 2025-07-10 Michael Clemens , Ana Marasović

AI agents powered by large language models are increasingly capable of autonomously completing complex, multi-step tasks using external tools. Yet, they still fall short of human-level performance in most domains including computer use,…

The advent of ML music models such as Google Magenta's MusicVAE now allow us to extract and replicate compositional features from otherwise complex datasets. These models allow computational composers to parameterize abstract variables such…

Multimedia · Computer Science 2021-12-06 Zack Harris , Liam Atticus Clarke , Pietro Gagliano , Dante Camarena , Manal Siddiqui , Pablo S. Castro

The ultimate purpose of generative music AI is music production. The studio-lab, a social form within the art-science branch of cross-disciplinarity, is a way to advance music production with AI music models. During a studio-lab experiment…

Sound · Computer Science 2026-05-18 Emmanuel Deruty , Maarten Grachten

This study presents an exploratory evaluation of Music Generation Systems (MGS) within contemporary music production workflows by examining eight open-source systems. The evaluation framework combines technical insights with practical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Shayan Dadman , Bernt Arild Bremdal , Andreas Bergsland

This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's…

Sound · Computer Science 2024-07-22 Shuoyang Zheng , Anna Xambó Sedó , Nick Bryan-Kinns

Improvisation training for actors presents unique challenges, particularly in maintaining narrative coherence and managing cognitive load during performances. Previous research on AI in improvisation performance often predates advances in…

Human-Computer Interaction · Computer Science 2025-07-01 Riccardo Drago , Yotam Sechayk , Mustafa Doga Dogan , Andrea Sanna , Takeo Igarashi

This article presents a five-year collaboration situated at the intersection of Art practice and Scientific research in Human-Computer Interaction (HCI). At the core of our collaborative work is a hybrid, Art and Science methodology that…

Human-Computer Interaction · Computer Science 2020-08-03 Baptiste Caramiaux , Marco Donnarumma

Electronic music artists and sound designers have unique workflow practices that necessitate specialized approaches for developing music information retrieval and creativity support tools. Furthermore, electronic music instruments, such as…

Sound · Computer Science 2022-10-28 Olga Vechtomova , Gaurav Sahu

State-of-the-art visual generative AI tools hold immense potential to assist users in the early ideation stages of creative tasks -- offering the ability to generate (rather than search for) novel and unprecedented (instead of existing)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Evans Xu Han , Alice Qian Zhang , Haiyi Zhu , Hong Shen , Paul Pu Liang , Jane Hsieh

Artificial intelligence (AI) is increasingly utilized in synthesizing visuals, texts, and audio. These AI-based works, often derived from neural networks, are entering the mainstream market, as digital paintings, songs, books, and others.…

Human-Computer Interaction · Computer Science 2023-03-21 Neo Christopher Chung

The use of machine learning in artistic music generation leads to controversial discussions of the quality of art, for which objective quantification is nonsensical. We therefore consider a music-generating algorithm as a counterpart to a…

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator…

Information Retrieval · Computer Science 2026-04-06 Arthur Câmara , Vincent Slot , Jakub Zavrel

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

Multimedia · Computer Science 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

AI music generation has advanced rapidly, with models like diffusion and autoregressive algorithms enabling high-fidelity outputs. These tools can alter styles, mix instruments, or isolate them. Since sound can be visualized as…

This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative…

Sound · Computer Science 2024-08-15 Jesse Allison , Drew Farrar , Treya Nash , Carlos Román , Morgan Weeks , Fiona Xue Ju

With the rise of artificial intelligence (AI), there has been increasing interest in human-AI co-creation in a variety of artistic domains including music as AI-driven systems are frequently able to generate human-competitive artifacts.…

Human-Computer Interaction · Computer Science 2025-04-22 Renaud Bougueng Tchemeube , Jeff Ens , Cale Plut , Philippe Pasquier , Maryam Safi , Yvan Grabit , Jean-Baptiste Rolland

In this work, we introduce Mozualization, a music generation and editing tool that creates multi-style embedded music by integrating diverse inputs, such as keywords, images, and sound clips (e.g., segments from various pieces of music or…

Human-Computer Interaction · Computer Science 2025-04-22 Wanfang Xu , Lixiang Zhao , Haiwen Song , Xinheng Song , Zhaolin Lu , Yu Liu , Min Chen , Eng Gee Lim , Lingyun Yu