English
Related papers

Related papers: Talking Drums: Generating drum grooves with neural…

200 papers

This study introduces a text-conditioned approach to generating drumbeats with Latent Diffusion Models (LDMs). It uses informative conditioning text extracted from training data filenames. By pretraining a text and drumbeat encoder through…

Sound · Computer Science 2024-08-07 Pushkar Jajoria , James McDermott

We investigate the problem of transforming an input sequence into a high-dimensional output sequence in order to transcribe polyphonic audio music into symbolic notation. We introduce a probabilistic model based on a recurrent neural…

Machine Learning · Computer Science 2012-12-11 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

Polyphonic music generation is still a challenge direction due to its correct between generating melody and harmony. Most of the previous studies used RNN-based models. However, the RNN-based models are hard to establish the relationship…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-08 Jiuyang Zhou , Hong Zhu , Xingping Wang

This paper describes a neural drum transcription method that detects from music signals the onset times of drums at the $\textit{tatum}$ level, where tatum times are assumed to be estimated in advance. In conventional studies on drum…

Sound · Computer Science 2020-10-09 Ryoto Ishizuka , Ryo Nishikimi , Eita Nakamura , Kazuyoshi Yoshii

Dance and music typically go hand in hand. The complexities in dance, music, and their synchronisation make them fascinating to study from a computational creativity perspective. While several works have looked at generating dance for a…

Sound · Computer Science 2021-07-21 Gunjan Aggarwal , Devi Parikh

A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a neural network architecture that predicts and generates polyphonic music aligned…

Sound · Computer Science 2018-04-23 Nikhil Kotecha , Paul Young

This paper introduces a novel data-driven strategy for synthesizing gramophone noise audio textures. A diffusion probabilistic model is applied to generate highly realistic quasiperiodic noises. The proposed model is designed to generate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Eloi Moliner , Vesa Välimäki

This paper proposes a model that generates a drum track in the audio domain to play along to a user-provided drum-free recording. Specifically, using paired data of drumless tracks and the corresponding human-made drum tracks, we train a…

Sound · Computer Science 2022-11-01 Yueh-Kao Wu , Ching-Yu Chiu , Yi-Hsuan Yang

Most existing text generation models follow the sequence-to-sequence paradigm. Generative Grammar suggests that humans generate natural language texts by learning language grammar. We propose a syntax-guided generation schema, which…

Computation and Language · Computer Science 2023-06-27 Yafu Li , Leyang Cui , Jianhao Yan , Yongjing Yin , Wei Bi , Shuming Shi , Yue Zhang

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang

In this paper, we introduce new methods and discuss results of text-based LSTM (Long Short-Term Memory) networks for automatic music composition. The proposed network is designed to learn relationships within text documents that represent…

Artificial Intelligence · Computer Science 2016-04-20 Keunwoo Choi , George Fazekas , Mark Sandler

A combination of a neural network with rule firing information from a rule-based system is used to generate segment durations for a text-to-speech system. The system shows a slight improvement in performance over a neural network system…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Gerald Corrigan , Noel Massey , Orhan Karaali

To train a machine learning model is necessary to take numerous decisions about many options for each process involved, in the field of sequence generation and more specifically of music composition, the nature of the problem helps to…

Sound · Computer Science 2021-01-20 Sebastian Garcia-Valencia , Alejandro Betancourt , Juan G. Lalinde-Pulido

In this paper, we propose a novel score-base generative model for unconditional raw audio synthesis. Our proposal builds upon the latest developments on diffusion process modeling with stochastic differential equations, which already…

Sound · Computer Science 2021-06-15 Simon Rouard , Gaëtan Hadjeres

This paper proposes deep learning techniques of generating designs for clothing, focused on handloom fabric and discusses the associated challenges along with its application. The capability of generative neural network models in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Rajat Kanti Bhattacharjee , Meghali Nandi , Amrit Jha , Gunajit Kalita , Ferdous Ahmed Barbhuiya

Sound effects model design commonly uses digital signal processing techniques with full control ability, but it is difficult to achieve realism within a limited number of parameters. Recently, neural sound effects synthesis methods have…

Sound · Computer Science 2025-03-13 Yisu Zong , Joshua Reiss

When people deliver a speech, they naturally move heads, and this rhythmic head motion conveys prosodic information. However, generating a lip-synced video while moving head naturally is challenging. While remarkably successful, existing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Lele Chen , Guofeng Cui , Celong Liu , Zhong Li , Ziyi Kou , Yi Xu , Chenliang Xu

An ideal music synthesizer should be both interactive and expressive, generating high-fidelity audio in realtime for arbitrary combinations of instruments and notes. Recent neural synthesizers have exhibited a tradeoff between…

Large language models generate code one token at a time. Their autoregressive generation process lacks the feedback of observing the program's output. Training LLMs to suggest edits directly can be challenging due to the scarcity of rich…

Artificial Intelligence · Computer Science 2024-06-03 Shreyas Kapur , Erik Jenner , Stuart Russell