English
Related papers

Related papers: MusicAIR: A Multimodal AI Music Generation Framewo…

200 papers

Machine Learning models are capable of generating complex music across a range of genres from folk to classical music. However, current generative music AI models are typically difficult to understand and control in meaningful ways. Whilst…

Sound · Computer Science 2023-08-14 Ashley Noel-Hirst , Nick Bryan-Kinns

Generative AI is becoming increasingly prevalent in creative fields, sparking urgent debates over how current copyright laws can keep pace with technological innovation. Recent controversies of AI models generating near-replicas of…

Machine Learning · Computer Science 2025-07-01 Archer Amon , Zhipeng Yin , Zichong Wang , Avash Palikhe , Wenbin Zhang

Music has always been thought of as a "human" endeavor -- when praising a piece of music, we emphasize the composer's creativity and the emotions the music invokes. Because music also heavily relies on patterns and repetition in the form of…

Sound · Computer Science 2024-01-05 Nicholas Yan

Video-to-music generation presents significant potential in video production, requiring the generated music to be both semantically and rhythmically aligned with the video. Achieving this alignment demands advanced music generation…

Sound · Computer Science 2024-12-10 Sifei Li , Binxin Yang , Chunji Yin , Chong Sun , Yuxin Zhang , Weiming Dong , Chen Li

Creating music is iterative, requiring varied methods at each stage. However, existing AI music systems fall short in orchestrating multiple subsystems for diverse needs. To address this gap, we introduce Loop Copilot, a novel system that…

Sound · Computer Science 2024-09-02 Yixiao Zhang , Akira Maezawa , Gus Xia , Kazuhiko Yamamoto , Simon Dixon

Vocals harmonizers are powerful tools to help solo vocalists enrich their melodies with harmonically supportive voices. These tools exist in various forms, from commercially available pedals and software to custom-built systems, each…

Human-Computer Interaction · Computer Science 2025-06-24 Lancelot Blanchard , Cameron Holt , Joseph A. Paradiso

Recent advances in generative AI have sparked renewed interest and expanded possibilities for music generation. However, the performance and versatility of these systems across musical genres are heavily influenced by the availability of…

Sound · Computer Science 2025-08-26 Atharva Mehta , Shivam Chauhan , Monojit Choudhury

The ultimate purpose of generative music AI is music production. The studio-lab, a social form within the art-science branch of cross-disciplinarity, is a way to advance music production with AI music models. During a studio-lab experiment…

Sound · Computer Science 2026-05-18 Emmanuel Deruty , Maarten Grachten

Generative AI is reshaping music creation, but its rapid growth exposes structural gaps in attribution, rights management, and economic models. Unlike past media shifts, from live performance to recordings, downloads, and streaming, AI…

Songwriting is often driven by multimodal inspirations, such as imagery, narratives, or existing music, yet songwriters remain unsupported by current music AI systems in incorporating these multimodal inputs into their creative processes.…

Human-Computer Interaction · Computer Science 2025-02-17 Yewon Kim , Sung-Ju Lee , Chris Donahue

With rapid advances in generative artificial intelligence, the text-to-music synthesis task has emerged as a promising direction for music generation. Nevertheless, achieving precise control over multi-track generation remains an open…

Sound · Computer Science 2024-12-18 Yao Yao , Peike Li , Boyu Chen , Alex Wang

Controllable music generation plays a vital role in human-AI music co-creation. While Large Language Models (LLMs) have shown promise in generating high-quality music, their focus on autoregressive generation limits their utility in music…

Sound · Computer Science 2024-10-08 Liwei Lin , Gus Xia , Yixiao Zhang , Junyan Jiang

Music is a powerful medium for altering the emotional state of the listener. In recent years, with significant advancement in computing capabilities, artificial intelligence-based (AI-based) approaches have become popular for creating…

Human-Computer Interaction · Computer Science 2023-01-18 Adyasha Dash , Kat R. Agres

Emotions critically influence mental health, driving interest in music-based affective computing via neurophysiological signals with Brain-computer Interface techniques. While prior studies leverage music's accessibility for emotion…

Sound · Computer Science 2025-08-08 Sha Zhao , Song Yi , Yangxuan Zhou , Jiadong Pan , Jiquan Wang , Jie Xia , Shijian Li , Shurong Dong , Gang Pan

Recent advances in generative AI for music have achieved remarkable fidelity and stylistic diversity, yet these systems often fail to align with nuanced human preferences due to the specific loss functions they use. This paper advocates for…

Sound · Computer Science 2025-11-20 Dorien Herremans , Abhinaba Roy

The rapid rise of generative AI has intensified copyright and economic tensions in creative industries, particularly in music. Current approaches addressing this challenge often focus on preventing infringement or establishing one-time…

Artificial Intelligence · Computer Science 2025-12-03 Junwei Deng , Xirui Jiang , Shiyuan Zhang , Shichang Zhang , Himabindu Lakkaraju , Ruijiang Gao , Chris Donahue , Jiaqi W. Ma

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

Recent advancements in music generation are raising multiple concerns about the implications of AI in creative music processes, current business models and impacts related to intellectual property management. A relevant discussion and…

Sound · Computer Science 2025-07-07 Roser Batlle-Roca , Wei-Hsiang Liao , Xavier Serra , Yuki Mitsufuji , Emilia Gómez

Songwriting has long served as a powerful medium for expressing unconscious emotions and fostering self-awareness in psychotherapy. Due to the auditory-centric nature of traditional approaches, Deaf and Hard-of-Hearing (DHH) individuals…

Human-Computer Interaction · Computer Science 2026-04-16 Youjin Choi , Jaeyoung Moon , Jinyoung Yoo , Jennifer G. Kim , Jin-Hyuk Hong

While generative models for music composition are increasingly capable, their adoption by musicians is hindered by text-prompting, an asynchronous workflow disconnected from the embodied, responsive nature of instrumental performance. To…

Sound · Computer Science 2025-11-04 Louis Bradshaw , Alexander Spangher , Stella Biderman , Simon Colton