English
Related papers

Related papers: Setting the rhythm scene: deep learning-based drum…

200 papers

There has recently been a sharp increase in interest in Artificial Intelligence-Generated Content (AIGC). Despite this, musical components such as time signatures have not been studied sufficiently to form an algorithmic determination…

Machine Learning · Computer Science 2025-07-10 Callie C. Liao , Duoduo Liao , Jesse Guessford

Deep generative models allow even novice composers to generate various melodies by sampling latent vectors. However, finding the desired melody is challenging since the latent space is unintuitive and high-dimensional. In this work, we…

Sound · Computer Science 2020-10-08 Yijun Zhou , Yuki Koyama , Masataka Goto , Takeo Igarashi

This paper presents the first step in a research project situated within the field of musical agents. The objective is to achieve, through training, the tuning of the desired musical relationship between a live musical input and a real-time…

Sound · Computer Science 2025-10-01 Balthazar Bujard , Jérôme Nika , Fédéric Bevilacqua , Nicolas Obin

Current methods for creating drum loop audio in digital music production, such as using one-shot samples or resampling, often demand non-trivial efforts of creators. While recent generative models achieve high fidelity and adhere to text,…

This paper proposes a word representation strategy for rhythm patterns. Using 1034 pieces of Nottingham Dataset, a rhythm word dictionary whose size is 450 (without control tokens) is generated. BERT model is created to explore syntactic…

Machine Learning · Computer Science 2020-09-04 Tongyu Lu , Lyucheng Yan , Gus Xia

The traditional songwriting process is rather complex and this is evident in the time it takes to produce lyrics that fit the genre and form comprehensive verses. Our project aims to simplify this process with deep learning techniques, thus…

Computation and Language · Computer Science 2024-09-24 Tracy Cai , Wilson Liang , Donte Townes

AI creation, such as poem or lyrics generation, has attracted increasing attention from both industry and academic communities, with many promising models proposed in the past few years. Existing methods usually estimate the outputs based…

Artificial Intelligence · Computer Science 2024-09-05 Qian Cao , Xu Chen , Ruihua Song , Hao Jiang , Guang Yang , Zhao Cao

Compositional generalization is a basic mechanism in human language learning, which current neural networks struggle with. A recently proposed Disentangled sequence-to-sequence model (Dangle) shows promising generalization capability by…

Computation and Language · Computer Science 2022-12-13 Hao Zheng , Mirella Lapata

While recent generative models can produce engaging music, their utility is limited. The variation in the music is often left to chance, resulting in compositions that lack structure. Pieces extending beyond a minute can become incoherent…

Sound · Computer Science 2023-11-01 Lilac Atassi

Analogy-making is a key method for computer algorithms to generate both natural and creative music pieces. In general, an analogy is made by partially transferring the music abstractions, i.e., high-level representations and their…

Sound · Computer Science 2019-10-22 Ruihan Yang , Dingsu Wang , Ziyu Wang , Tianyao Chen , Junyan Jiang , Gus Xia

Machine generation of symbolic music and digital audio are hot topics but there have been relatively few digital musical instruments that integrate generative AI. Present musical AI tools are not artist centred and do not support…

Sound · Computer Science 2026-04-28 Charles Patrick Martin

Generating a chord progression from a monophonic melody is a challenging problem because a chord progression requires a series of layered notes played simultaneously. This paper presents a novel method of generating chord sequences from a…

Sound · Computer Science 2017-12-05 Hyungui Lim , Seungyeon Rhyu , Kyogu Lee

Many aspects of human reasoning, including language, require learning rules from very little data. Humans can do this, often learning systematic rules from very few examples, and combining these rules to form compositional rule-based…

Artificial Intelligence · Computer Science 2020-10-26 Maxwell I. Nye , Armando Solar-Lezama , Joshua B. Tenenbaum , Brenden M. Lake

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

Large Language Models (LLM) have shown encouraging progress in multimodal understanding and generation tasks. However, how to design a human-aligned and interpretable melody composition system is still under-explored. To solve this problem,…

Sound · Computer Science 2024-03-08 Xia Liang , Xingjian Du , Jiaju Lin , Pei Zou , Yuan Wan , Bilei Zhu

In this paper we introduce StyleWaveGAN, a style-based drum sound generator that is a variation of StyleGAN, a state-of-the-art image generator. By conditioning StyleWaveGAN on both the type of drum and several audio descriptors, we are…

Sound · Computer Science 2022-08-29 Antoine Lavault , Axel Roebel , Matthieu Voiry

Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality itself, e.g., as sequences of symbolic notes. This observation…

Sound · Computer Science 2025-09-30 Junyan Jiang , Daniel Chin , Liwei Lin , Xuanjie Liu , Gus Xia

The purpose of this paper is to present a method for automatic classification of dialogue utterances and the results of applying that method to a corpus. Superficial features of a set of training utterances (which we will call cues) are…

cmp-lg · Computer Science 2008-02-03 Toine Andernach

The two main research threads in computer-based music generation are: the construction of autonomous music-making systems, and the design of computer-based environments to assist musicians. In the symbolic domain, the key problem of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-12 Giorgio Barnabò , Giovanni Trappolini , Lorenzo Lastilla , Cesare Campagnano , Angela Fan , Fabio Petroni , Fabrizio Silvestri

We pose 3D scene-understanding as a problem of parsing in a grammar. A grammar helps us capture the compositional structure of real-word objects, e.g., a chair is composed of a seat, a back-rest and some legs. Having multiple rules for an…

Computer Vision and Pattern Recognition · Computer Science 2012-11-09 Abhishek Anand , Sherwin Li