English
Related papers

Related papers: A Comprehensive Survey on Deep Music Generation: M…

200 papers

Deep generative models for symbolic music are typically designed to model temporal dependencies in music so as to predict the next musical event given previous events. In many cases, such models are expected to learn abstract concepts such…

Sound · Computer Science 2019-07-12 Benjamin Genchel , Ashis Pati , Alexander Lerch

Deep learning has rapidly become the state-of-the-art approach for music generation. However, training a deep model typically requires a large training set, which is often not available for specific musical styles. In this paper, we present…

Sound · Computer Science 2020-07-22 Alisa Liu , Alexander Fang , Gaëtan Hadjeres , Prem Seetharaman , Bryan Pardo

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

Optical Music Recognition (OMR) is concerned with transcribing sheet music into a machine-readable format. The transcribed copy should allow musicians to compose, play and edit music by taking a picture of a music sheet. Complete…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Elona Shatri , György Fazekas

Deep generative models have unlocked another profound realm of human creativity. By capturing and generalizing patterns within data, we have entered the epoch of all-encompassing Artificial Intelligence for General Creativity (AIGC).…

Artificial Intelligence · Computer Science 2023-12-27 Hanqun Cao , Cheng Tan , Zhangyang Gao , Yilun Xu , Guangyong Chen , Pheng-Ann Heng , Stan Z. Li

How does textual representation of audio relate to the Large Language Model's (LLMs) learning about the audio world? This research investigates the extent to which LLMs can be prompted to generate audio, despite their primary training in…

Songs, as a central form of musical art, exemplify the richness of human intelligence and creativity. While recent advances in generative modeling have enabled notable progress in long-form song generation, current systems for full-length…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Huakang Chen , Yuepeng Jiang , Guobin Ma , Chunbo Hao , Shuai Wang , Jixun Yao , Ziqian Ning , Meng Meng , Jian Luan , Lei Xie

Music is an art, perceived in unique ways by every listener, coming from acoustic signals. In the meantime, standards as musical scores exist to describe it. Even if humans can make this transcription, it is costly in terms of time and…

Sound · Computer Science 2021-07-26 Axel Marmoret , Nancy Bertin , Jeremy Cohen

Recent deep learning approaches have achieved impressive performance on visual sound separation tasks. However, these approaches are mostly built on appearance and optical flow like motion feature representations, which exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Chuang Gan , Deng Huang , Hang Zhao , Joshua B. Tenenbaum , Antonio Torralba

In this paper we present current trends in real-time music tracking (a.k.a. score following). Casually speaking, these algorithms "listen" to a live performance of music, compare the audio signal to an abstract representation of the score,…

Multimedia · Computer Science 2017-08-08 Andreas Arzt , Matthias Dorfer

Music is a powerful medium for altering the emotional state of the listener. In recent years, with significant advancement in computing capabilities, artificial intelligence-based (AI-based) approaches have become popular for creating…

Human-Computer Interaction · Computer Science 2023-01-18 Adyasha Dash , Kat R. Agres

We introduce a film score generation framework to harmonize visual pixels and music melodies utilizing a latent diffusion model. Our framework processes film clips as input and generates music that aligns with a general theme while offering…

Multimedia · Computer Science 2024-11-13 F. Qi , L. Ni , C. Xu

Music has always been central to human culture, reflecting and shaping traditions, emotions, and societal changes. Technological advancements have transformed how music is created and consumed, influencing tastes and the music itself. In…

Following their success in Computer Vision and other areas, deep learning techniques have recently become widely adopted in Music Information Retrieval (MIR) research. However, the majority of works aim to adopt and assess methods that have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Keunwoo Choi , György Fazekas , Kyunghyun Cho , Mark Sandler

Artistic work leveraging Machine Learning techniques is an increasingly popular endeavour for those with a creative lean. However, most work is done in a single domain: text, images, music, etc. In this work, I design a system for a machine…

Artificial Intelligence · Computer Science 2023-01-12 Matthew L. Olson

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

This study presents an exploratory evaluation of Music Generation Systems (MGS) within contemporary music production workflows by examining eight open-source systems. The evaluation framework combines technical insights with practical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Shayan Dadman , Bernt Arild Bremdal , Andreas Bergsland

AI-based music generation has made significant progress in recent years. However, generating symbolic music that is both long-structured and expressive remains a significant challenge. In this paper, we propose PerceiverS (Segmentation and…

Artificial Intelligence · Computer Science 2025-09-23 Yungang Yi , Weihua Li , Matthew Kuo , Quan Bai

Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial…

Sound · Computer Science 2021-05-05 Shiguang Liu , Dinesh Manocha

Music-to-music-video generation is a challenging task due to the intrinsic differences between the music and video modalities. The advent of powerful text-to-video diffusion models has opened a promising pathway for music-video (MV)…

Sound · Computer Science 2025-03-17 Zhuoyuan Mao , Mengjie Zhao , Qiyu Wu , Zhi Zhong , Wei-Hsiang Liao , Hiromi Wakaki , Yuki Mitsufuji