English
Related papers

Related papers: DDSP-based Neural Waveform Synthesis of Polyphonic…

200 papers

We present a framework based on neural networks to extract music scores directly from polyphonic audio in an end-to-end fashion. Most previous Automatic Music Transcription (AMT) methods seek a piano-roll representation of the pitches, that…

Sound · Computer Science 2019-10-29 Miguel A. Román , Antonio Pertusa , Jorge Calvo-Zaragoza

While end-to-end lyrics-to-song models offer convenience for casual users, professional songwriters require score-to-song systems that allow them to retain authorship over the core melody. However, existing score-to-song methods are limited…

This paper introduces a novel data-driven strategy for synthesizing gramophone noise audio textures. A diffusion probabilistic model is applied to generate highly realistic quasiperiodic noises. The proposed model is designed to generate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Eloi Moliner , Vesa Välimäki

Deep learning models have become a critical tool for analysis and classification of musical data. These models operate either on the audio signal, e.g. waveform or spectrogram, or on a symbolic representation, such as MIDI. In the latter,…

Sound · Computer Science 2024-07-26 Léo Géré , Philippe Rigaux , Nicolas Audebert

Graphs can be leveraged to model polyphonic multitrack symbolic music, where notes, chords and entire sections may be linked at different levels of the musical hierarchy by tonal and rhythmic relationships. Nonetheless, there is a lack of…

Sound · Computer Science 2023-07-28 Emanuele Cosenza , Andrea Valenti , Davide Bacciu

Recent MIDI-to-audio synthesis methods using deep neural networks have successfully generated high-quality, expressive instrumental tracks. However, these methods require MIDI annotations for supervised training, limiting the diversity of…

Sound · Computer Science 2025-06-12 Osamu Take , Taketo Akama

This project presents an AI-based system for tone replication in music production, focusing on predicting EQ parameter settings directly from audio features. Unlike traditional audio-to-audio methods, our approach outputs interpretable…

Sound · Computer Science 2025-09-30 Song-Ze Yu

Most generative models of audio directly generate samples in one of two domains: time or frequency. While sufficient to express any signal, these representations are inefficient, as they do not utilize existing knowledge of how sound is…

Machine Learning · Computer Science 2020-01-15 Jesse Engel , Lamtharn Hantrakul , Chenjie Gu , Adam Roberts

Automatic transcription of guitar strumming is an underrepresented and challenging task in Music Information Retrieval (MIR), particularly for extracting both strumming directions and chord progressions from audio signals. While existing…

Sound · Computer Science 2025-08-12 Sebastian Murgul , Johannes Schimper , Michael Heizmann

This thesis is presenting a method for generating short musical phrases using a deep convolutional generative adversarial network (DCGAN). To train neural network were used datasets of classical and jazz music MIDI recordings. Our approach…

Sound · Computer Science 2019-12-24 Mateusz Dorobek

In this paper, we present a neural network approach for synchronizing audio recordings of human piano performances with their corresponding loosely aligned MIDI files. The task is addressed using a Convolutional Recurrent Neural Network…

Sound · Computer Science 2025-06-30 Sebastian Murgul , Moritz Reiser , Michael Heizmann , Christoph Seibert

In this paper, we introduce a simple method that can separate arbitrary musical instruments from an audio mixture. Given an unaligned MIDI transcription for a target instrument from an input mixture, we synthesize new mixtures from the midi…

Sound · Computer Science 2020-09-30 Ethan Manilow , Bryan Pardo

A differentiable digital signal processing (DDSP) autoencoder is a musical sound synthesizer that combines a deep neural network (DNN) and spectral modeling synthesis. It allows us to flexibly edit sounds by changing the fundamental…

The traditional vocoders have the advantages of high synthesis efficiency, strong interpretability, and speech editability, while the neural vocoders have the advantage of high synthesis quality. To combine the advantages of two vocoders,…

Sound · Computer Science 2022-03-08 Tao Wang , Ruibo Fu , Jiangyan Yi , Jianhua Tao , Zhengqi Wen

Neural audio synthesis methods can achieve high-fidelity and realistic sound generation by utilizing deep generative models. Such models typically rely on external labels which are often discrete as conditioning information to achieve…

Sound · Computer Science 2024-06-12 Yunyi Liu , Craig Jin

Sound synthesis is a complex field that requires domain expertise. Manual tuning of synthesizer parameters to match a specific sound can be an exhaustive task, even for experienced sound engineers. In this paper, we introduce InverSynth -…

Sound · Computer Science 2019-11-22 Oren Barkan , David Tsiris , Ori Katz , Noam Koenigstein

We propose an audio effects processing framework that learns to emulate a target electric guitar tone from a recording. We train a deep neural network using an adversarial approach, with the goal of transforming the timbre of a guitar, into…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Alec Wright , Vesa Välimäki , Lauri Juvela

We investigate the problem of transforming an input sequence into a high-dimensional output sequence in order to transcribe polyphonic audio music into symbolic notation. We introduce a probabilistic model based on a recurrent neural…

Machine Learning · Computer Science 2012-12-11 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

Music generation in the audio domain using artificial intelligence (AI) has witnessed steady progress in recent years. However for some instruments, particularly the guitar, controllable instrument synthesis remains limited in expressivity.…

Sound · Computer Science 2025-10-28 Jackson Loth , Pedro Sarmento , Mark Sandler , Mathieu Barthet

The first step to apply deep learning techniques for symbolic music understanding is to transform musical pieces (mainly in MIDI format) into sequences of predefined tokens like note pitch, note velocity, and chords. Subsequently, the…

Sound · Computer Science 2023-12-18 Jinhao Tian , Zuchao Li , Jiajia Li , Ping Wang