English
Related papers

Related papers: XMusic: Towards a Generalized and Controllable Sym…

200 papers

Diffusion models have shown promising results for a wide range of generative tasks with continuous data, such as image and audio synthesis. However, little progress has been made on using diffusion models to generate discrete symbolic music…

Sound · Computer Science 2023-10-24 Jincheng Zhang , György Fazekas , Charalampos Saitis

In this work, we provide a comprehensive survey of AI music generation tools, including both research projects and commercialized applications. To conduct our analysis, we classified music generation approaches into three categories:…

Sound · Computer Science 2023-08-28 Yueyue Zhu , Jared Baca , Banafsheh Rekabdar , Reza Rawassizadeh

In recent decades, neuroscientific and psychological research has traced direct relationships between taste and auditory perceptions. This article explores multimodal generative models capable of converting taste information into music,…

Sound · Computer Science 2025-09-01 Matteo Spanio , Massimiliano Zampini , Antonio Rodà , Franco Pierucci

Providing soundtracks for videos remains a costly and time-consuming challenge for multimedia content creators. We introduce EMSYNC, an automatic video-based symbolic music generator that creates music aligned with a video's emotional…

Sound · Computer Science 2026-02-06 Serkan Sulun , Paula Viana , Matthew E. P. Davies

The recent explosion of generative AI-Music systems has raised numerous concerns over data copyright, licensing music from musicians, and the conflict between open-source AI and large prestige companies. Such issues highlight the need for…

Sound · Computer Science 2025-03-18 Phillip Long , Zachary Novack , Taylor Berg-Kirkpatrick , Julian McAuley

With the advancement of generative models, the synthesis of different sensory elements such as music, visuals, and speech has achieved significant realism. However, the approach to generate multi-sensory outputs has not been fully explored,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Minheng Ni , Chenfei Wu , Huaying Yuan , Zhengyuan Yang , Ming Gong , Lijuan Wang , Zicheng Liu , Wangmeng Zuo , Nan Duan

Machine Learning models are capable of generating complex music across a range of genres from folk to classical music. However, current generative music AI models are typically difficult to understand and control in meaningful ways. Whilst…

Sound · Computer Science 2023-08-14 Ashley Noel-Hirst , Nick Bryan-Kinns

Music composition represents the creative side of humanity, and itself is a complex task that requires abilities to understand and generate information with long dependency and harmony constraints. While demonstrating impressive…

With the development of deep neural networks, automatic music composition has made great progress. Although emotional music can evoke listeners' different emotions and it is important for artistic expression, only few researches have…

Sound · Computer Science 2021-12-17 Kaitong Zheng , Ruijie Meng , Chengshi Zheng , Xiaodong Li , Jinqiu Sang , Juanjuan Cai , Jie Wang

The generation of musically coherent and aesthetically pleasing harmony remains a significant challenge in the field of algorithmic composition. This paper introduces an innovative Agentic AI-enabled Higher Harmony Music Generator, a…

Sound · Computer Science 2025-10-02 Nia D'Souza Ganapathy , Arul Selvamani Shaja

Emotions critically influence mental health, driving interest in music-based affective computing via neurophysiological signals with Brain-computer Interface techniques. While prior studies leverage music's accessibility for emotion…

Sound · Computer Science 2025-08-08 Sha Zhao , Song Yi , Yangxuan Zhou , Jiadong Pan , Jiquan Wang , Jie Xia , Shijian Li , Shurong Dong , Gang Pan

Existing text-to-music models can produce high-quality audio with great diversity. However, textual prompts alone cannot precisely control temporal musical features such as chords and rhythm of the generated music. To address this…

Sound · Computer Science 2024-07-23 Yun-Han Lan , Wen-Yi Hsiao , Hao-Chung Cheng , Yi-Hsuan Yang

In recent years, artificial intelligence (AI) has made significant progress in the field of music generation, driving innovation in music creation and applications. This paper provides a systematic review of the latest research advancements…

Sound · Computer Science 2024-09-06 Yanxu Chen , Linshu Huang , Tian Gou

Music is a powerful medium for altering the emotional state of the listener. In recent years, with significant advancement in computing capabilities, artificial intelligence-based (AI-based) approaches have become popular for creating…

Human-Computer Interaction · Computer Science 2023-01-18 Adyasha Dash , Kat R. Agres

Music generation has advanced markedly through multimodal deep learning, enabling models to synthesize audio from text and, more recently, from images. However, existing image-conditioned systems suffer from two fundamental limitations: (i)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Ivan Rinaldi , Matteo Mendula , Nicola Fanelli , Florence Levé , Matteo Testi , Giovanna Castellano , Gennaro Vessio

AI-based music generation has made significant progress in recent years. However, generating symbolic music that is both long-structured and expressive remains a significant challenge. In this paper, we propose PerceiverS (Segmentation and…

Artificial Intelligence · Computer Science 2025-09-23 Yungang Yi , Weihua Li , Matthew Kuo , Quan Bai

Conventional music visualisation systems rely on handcrafted ad hoc transformations of shapes and colours that offer only limited expressiveness. We propose two novel pipelines for automatically generating music videos from any…

In recent years, AI-Generated Content (AIGC) has witnessed rapid advancements, facilitating the creation of music, images, and other artistic forms across a wide range of industries. However, current models for image- and video-to-music…

Sound · Computer Science 2024-11-26 Jiajun Li , Tianze Xu , Xuesong Chen , Xinrui Yao , Shuchang Liu

Music has always been thought of as a "human" endeavor -- when praising a piece of music, we emphasize the composer's creativity and the emotions the music invokes. Because music also heavily relies on patterns and repetition in the form of…

Sound · Computer Science 2024-01-05 Nicholas Yan

Machine-generated music (MGM) has become a groundbreaking innovation with wide-ranging applications, such as music therapy, personalised editing, and creative inspiration within the music industry. However, the unregulated proliferation of…

Sound · Computer Science 2026-04-30 Yupei Li , Qiyang Sun , Hanqian Li , Lucia Specia , Björn W. Schuller