English
Related papers

Related papers: Sequence-to-Sequence Piano Transcription with Tran…

200 papers

Automatic Music Transcription (AMT), aiming to get musical notes from raw audio, typically uses frame-level systems with piano-roll outputs or language model (LM)-based systems with note-level predictions. However, frame-level systems…

Sound · Computer Science 2025-01-08 Dichucheng Li , Yongyi Zang , Qiuqiang Kong

In this paper, we explore the tokenized representation of musical scores using the Transformer model to automatically generate musical scores. Thus far, sequence models have yielded fruitful results with note-level (MIDI-equivalent)…

Sound · Computer Science 2021-12-02 Masahiro Suzuki

A central goal in automatic music transcription is to detect individual note events in music recordings. An important variant is instrument-dependent music transcription where methods can use calibration data for the instruments in use.…

Sound · Computer Science 2017-11-01 Sebastian Ewert , Mark B. Sandler

Music transcription plays a pivotal role in Music Information Retrieval (MIR), particularly for stringed instruments like the guitar, where symbolic music notations such as MIDI lack crucial playability information. This contribution…

Sound · Computer Science 2025-06-18 Anna Hamberger , Sebastian Murgul , Jochen Schmidt , Michael Heizmann

This paper introduces a novel method for emulating piano sounds. We propose to exploit the sines, transient, and noise decomposition to design a differentiable spectral modeling synthesizer replicating piano notes. Three sub-modules learn…

Sound · Computer Science 2025-02-04 Riccardo Simionato , Stefano Fasciani

A great number of deep learning based models have been recently proposed for automatic music composition. Among these models, the Transformer stands out as a prominent approach for generating expressive classical piano performance with a…

Sound · Computer Science 2020-08-11 Yu-Siang Huang , Yi-Hsuan Yang

An ideal music synthesizer should be both interactive and expressive, generating high-fidelity audio in realtime for arbitrary combinations of instruments and notes. Recent neural synthesizers have exhibited a tradeoff between…

Automatic Music Transcription (AMT), inferring musical notes from raw audio, is a challenging task at the core of music understanding. Unlike Automatic Speech Recognition (ASR), which typically focuses on the words of a single speaker, AMT…

Sound · Computer Science 2022-03-16 Josh Gardner , Ian Simon , Ethan Manilow , Curtis Hawthorne , Jesse Engel

Systems for synthesizer sound matching, which automatically set the parameters of a synthesizer to emulate an input sound, have the potential to make the process of synthesizer programming faster and easier for novice and experienced…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-24 Fred Bruford , Frederik Blang , Shahan Nercessian

We investigate the problem of transforming an input sequence into a high-dimensional output sequence in order to transcribe polyphonic audio music into symbolic notation. We introduce a probabilistic model based on a recurrent neural…

Machine Learning · Computer Science 2012-12-11 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

Beat tracking in musical performance MIDI is a challenging and important task for notation-level music transcription and rhythmical analysis, yet existing methods primarily focus on audio-based approaches. This paper proposes an end-to-end…

Sound · Computer Science 2025-07-02 Sebastian Murgul , Michael Heizmann

Recent years have witnessed a growing interest in research related to the detection of piano pedals from audio signals in the music information retrieval community. However, to our best knowledge, recent generative models for symbolic music…

Sound · Computer Science 2021-11-03 Joann Ching , Yi-Hsuan Yang

Attention-based Transformer models have been increasingly employed for automatic music generation. To condition the generation process of such a model with a user-specified sequence, a popular approach is to take that conditioning sequence…

Sound · Computer Science 2022-03-22 Yi-Jen Shih , Shih-Lun Wu , Frank Zalkow , Meinard Müller , Yi-Hsuan Yang

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurrent neural network…

Machine Learning · Computer Science 2012-07-03 Nicolas Boulanger-Lewandowski , Yoshua Bengio , Pascal Vincent

The polyphonic nature of music makes the application of deep learning to music modelling a challenging task. On the other hand, the Transformer architecture seems to be a good fit for this kind of data. In this work, we present Calliope, a…

Sound · Computer Science 2021-07-13 Andrea Valenti , Stefano Berti , Davide Bacciu

We present a sequential transfer learning framework for transformers on functional Magnetic Resonance Imaging (fMRI) data and demonstrate its significant benefits for decoding musical timbre. In the first of two phases, we pre-train our…

Quantitative Methods · Quantitative Biology 2023-05-23 Sean Paulsen , Michael Casey

Representing symbolic music with compound tokens, where each token consists of several different sub-tokens representing a distinct musical feature or attribute, offers the advantage of reducing sequence length. While previous research has…

Sound · Computer Science 2026-03-17 HaeJun Yoo , Hao-Wen Dong , Jongmin Jung , Dasaem Jeong

Systematic compositionality is an essential mechanism in human language, allowing the recombination of known parts to create novel expressions. However, existing neural models have been shown to lack this basic ability in learning symbolic…

Computation and Language · Computer Science 2021-10-01 Yichen Jiang , Mohit Bansal

Most work on musical score models (a.k.a. musical language models) for music transcription has focused on describing the local sequential dependence of notes in musical scores and failed to capture their global repetitive structure, which…

Sound · Computer Science 2021-02-17 Eita Nakamura , Kazuyoshi Yoshii

Deep learning models have become a critical tool for analysis and classification of musical data. These models operate either on the audio signal, e.g. waveform or spectrogram, or on a symbolic representation, such as MIDI. In the latter,…

Sound · Computer Science 2024-07-26 Léo Géré , Philippe Rigaux , Nicolas Audebert