English
Related papers

Related papers: Music2P: A Multi-Modal AI-Driven Tool for Simplify…

200 papers

Musical professionals who produce material for non-musical stakeholders often face communication challenges in the early ideation stage. Expressing musical ideas can be difficult, especially when domain-specific vocabulary is lacking. This…

Human-Computer Interaction · Computer Science 2023-03-03 Sebastian Löbbers , Mathieu Barthet , György Fazekas

Generative AI is reshaping music creation, but its rapid growth exposes structural gaps in attribution, rights management, and economic models. Unlike past media shifts, from live performance to recordings, downloads, and streaming, AI…

Cover song generation stands out as a popular way of music making in the music-creative community. In this study, we introduce Piano Cover Generation (PiCoGen), a two-stage approach for automatic cover song generation that transcribes the…

Sound · Computer Science 2024-07-31 Chih-Pin Tan , Shuen-Huei Guan , Yi-Hsuan Yang

Challenges in managing linguistic diversity and integrating various musical modalities are faced by current music information retrieval systems. These limitations reduce their effectiveness in a global, multimodal music environment. To…

CLIP (Contrastive Language-Image Pre-Training) is a multimodal neural network trained on (text, image) pairs to predict the most relevant text caption given an image. It has been used extensively in image generation by connecting its output…

Multimedia · Computer Science 2024-06-04 Zhouyao Xie , Nikhil Yadala , Xinyi Chen , Jing Xi Liu

Despite its potential, AI advances in music education are hindered by proprietary systems that limit the democratization of technology in this domain. In particular, AI-driven music difficulty adjustment is especially promising, as…

Sound · Computer Science 2025-11-25 Pedro Ramoneda , Emilia Parada-Cabaleiro , Dasaem Jeong , Xavier Serra

Music evokes emotion in many people. We introduce a novel way to manipulate the emotional content of a song using AI tools. Our goal is to achieve the desired emotion while leaving the original melody as intact as possible. For this, we…

Sound · Computer Science 2024-06-14 Adel N. Abdalla , Jared Osborne , Razvan Andonie

We introduce a multi-modal discriminative and generative frame-work capable of assisting humans in producing visual content re-lated to a given theme, starting from a collection of documents(textual, visual, or both). This framework can be…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Michele Merler , Cicero Nogueira dos Santos , Mauro Martino , Alfio M. Gliozzo , John R. Smith

Audio representations for music information retrieval are typically learned via supervised learning in a task-specific fashion. Although effective at producing state-of-the-art results, this scheme lacks flexibility with respect to the…

Sound · Computer Science 2022-02-18 Ilaria Manco , Emmanouil Benetos , Elio Quinton , Gyorgy Fazekas

Music generation aims to create music segments that align with human aesthetics based on diverse conditional information. Despite advancements in generating music from specific textual descriptions (e.g., style, genre, instruments), the…

Sound · Computer Science 2025-04-21 Jiahao Song , Yuzhao Wang

The main goal of the Artap project is to provide an extensive infrastructure for robust design optimization, where usually many different numerical solvers have to be used together and the impact of the manufacturing uncertainties have to…

Optimization and Control · Mathematics 2020-01-08 David Pánek , Tamás Orosz , Pavel Karban

This work studies how to transform an album to vivid and coherent stories, a task we refer to as "album storytelling". While this task can help preserve memories and facilitate experience sharing, it remains an underexplored area in current…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Munan Ning , Yujia Xie , Dongdong Chen , Zeyin Song , Lu Yuan , Yonghong Tian , Qixiang Ye , Li Yuan

Text-guided image generation has witnessed unprecedented progress due to the development of diffusion models. Beyond text and image, sound is a vital element within the sphere of human perception, offering vivid representations and…

Graphics · Computer Science 2023-06-21 Yue Yang , Kaipeng Zhang , Yuying Ge , Wenqi Shao , Zeyue Xue , Yu Qiao , Ping Luo

Music genre classification has been widely studied in past few years for its various applications in music information retrieval. Previous works tend to perform unsatisfactorily, since those methods only use audio content or jointly use…

Sound · Computer Science 2023-06-13 Ganghui Ru , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Recent advancements in music large language models (LLMs) have significantly improved music understanding tasks, which involve the model's ability to analyze and interpret various musical elements. These improvements primarily focused on…

Sound · Computer Science 2025-09-24 Zhuoyuan Mao , Mengjie Zhao , Qiyu Wu , Hiromi Wakaki , Yuki Mitsufuji

Building artificial intelligence (AI) systems on top of a set of foundation models (FMs) is becoming a new paradigm in AI research. Their representative and generative abilities learnt from vast amounts of data can be easily adapted and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Heng Wang , Jianbo Ma , Santiago Pascual , Richard Cartwright , Weidong Cai

In this work, we provide a comprehensive survey of AI music generation tools, including both research projects and commercialized applications. To conduct our analysis, we classified music generation approaches into three categories:…

Sound · Computer Science 2023-08-28 Yueyue Zhu , Jared Baca , Banafsheh Rekabdar , Reza Rawassizadeh

As Artificial Intelligence (AI) technologies continue to evolve, their use in generating realistic, contextually appropriate content has expanded into various domains. Music, an art form and medium for entertainment, deeply rooted into…

Sound · Computer Science 2024-12-11 Yupei Li , Manuel Milling , Lucia Specia , Björn W. Schuller

This paper investigates the importance of personal ownership in musical AI design, examining how practising musicians can maintain creative control over the compositional process. Through a four-week ecological evaluation, we examined how a…

Human-Computer Interaction · Computer Science 2025-10-08 Stephen James Krol , Maria Teresa Llano , Jon McCormack

Locating the right sound effect efficiently is an important yet challenging topic for audio production. Most current sound-searching systems rely on pre-annotated audio labels created by humans, which can be time-consuming to produce and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-23 Haohe Liu , Thomas Deacon , Wenwu Wang , Matt Paradis , Mark D. Plumbley