English
Related papers

Related papers: Deep Learning Techniques for Music Generation -- A…

200 papers

Conventional music visualisation systems rely on handcrafted ad hoc transformations of shapes and colours that offer only limited expressiveness. We propose two novel pipelines for automatically generating music videos from any…

Automatic generation of sequences has been a highly explored field in the last years. In particular, natural language processing and automatic music composition have gained importance due to the recent advances in machine learning and…

Sound · Computer Science 2020-12-03 Sebastian Garcia-Valencia , Alejandro Betancourt , Juan G. Lalinde-Pulido

This paper presents an architecture for generating music for video games based on the Transformer deep learning model. Our motivation is to be able to customize the generation according to the taste of the player, who can select a corpus of…

Generative AI has been transforming the way we interact with technology and consume content. In the next decade, AI technology will reshape how we create audio content in various media, including music, theater, films, games, podcasts, and…

Sound · Computer Science 2024-11-25 Hao-Wen Dong

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

Modelling musical structure is vital yet challenging for artificial intelligence systems that generate symbolic music compositions. This literature review dissects the evolution of techniques for incorporating coherent structure, from…

Sound · Computer Science 2024-03-14 Keshav Bhandari , Simon Colton

Automatic Music Generation (AMG) has become an interesting research topic for many scientists in artificial intelligence, who are also interested in the music industry. One of the main challenges in AMG is that there is no clear objective…

Artificial Intelligence · Computer Science 2022-06-06 Maryam Majidi , Rahil Mahdian Toroghi

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applications. This paper reviews this field, categorizing music…

Sound · Computer Science 2026-03-09 Shuyu Li , Shulei Ji , Zihao Wang , Songruoyao Wu , Jiaxing Yu , Kejun Zhang

Music generation is always interesting in a sense that there is no formalized recipe. In this work, we propose a novel dual-track architecture for generating classical piano music, which is able to model the inter-dependency of left-hand…

Sound · Computer Science 2020-05-12 Sudi Lyu , Anxiang Zhang , Rong Song

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score…

Machine Learning · Computer Science 2020-04-14 Ashis Pati , Alexander Lerch , Gaëtan Hadjeres

End-to-end generation of musical audio using deep learning techniques has seen an explosion of activity recently. However, most models concentrate on generating fully mixed music in response to abstract conditioning information. In this…

In this work, we provide a comprehensive survey of AI music generation tools, including both research projects and commercialized applications. To conduct our analysis, we classified music generation approaches into three categories:…

Sound · Computer Science 2023-08-28 Yueyue Zhu , Jared Baca , Banafsheh Rekabdar , Reza Rawassizadeh

We apply deep learning methods, specifically long short-term memory (LSTM) networks, to music transcription modelling and composition. We build and train LSTM networks using approximately 23,000 music transcriptions expressed with a…

Sound · Computer Science 2016-05-02 Bob L. Sturm , João Felipe Santos , Oded Ben-Tal , Iryna Korshunova

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

Sound · Computer Science 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard

Musical mode is one of the most critical element that establishes the framework of pitch organization and determines the harmonic relationships. Previous works often use the simplistic and rigid alignment method, and overlook the diversity…

Sound · Computer Science 2025-01-15 Qian Liang , Yi Zeng , Menghaoran Tang

In the use of deep neural networks, it is crucial to provide appropriate input representations for the network to learn from. In this paper, we propose an approach to learn a representation that focus on rhythmic representation which is…

Sound · Computer Science 2017-12-15 Yeonwoo Jeong , Keunwoo Choi , Hosan Jeong

Despite advances in deep algorithmic music generation, evaluation of generated samples often relies on human evaluation, which is subjective and costly. We focus on designing a homogeneous, objective framework for evaluating samples of…

Large deep-learning models for music, including those focused on learning general-purpose music audio representations, are often assumed to require substantial training data to achieve high performance. If true, this would pose challenges…

Sound · Computer Science 2025-05-12 Christos Plachouras , Emmanouil Benetos , Johan Pauwels

Music is one of the Gardner's intelligences in his theory of multiple intelligences. How humans perceive and understand music is still being studied and is crucial to develop artificial intelligence models that imitate such processes. Music…

Artificial Intelligence · Computer Science 2022-11-04 Carlos Hernandez-Olivan , Javier Hernandez-Olivan , Jose R. Beltran

Most existing neural network models for music generation use recurrent neural networks. However, the recent WaveNet model proposed by DeepMind shows that convolutional neural networks (CNNs) can also generate realistic musical waveforms in…

Sound · Computer Science 2017-07-19 Li-Chia Yang , Szu-Yu Chou , Yi-Hsuan Yang