English
Related papers

Related papers: Towards Efficient and Real-Time Piano Transcriptio…

200 papers

Automatic drum transcription, a subtask of the more general automatic music transcription, deals with extracting drum instrument note onsets from an audio source. Recently, progress in transcription performance has been made using…

Sound · Computer Science 2018-10-04 Richard Vogl , Gerhard Widmer , Peter Knees

We present an automatic piano transcription system that converts polyphonic audio recordings into musical scores. This has been a long-standing problem of music information processing, and recent studies have made remarkable progress in the…

Sound · Computer Science 2021-04-06 Kentaro Shibata , Eita Nakamura , Kazuyoshi Yoshii

Detecting piano pedalling techniques in polyphonic music remains a challenging task in music information retrieval. While other piano-related tasks, such as pitch estimation and onset detection, have seen improvement through applying deep…

Sound · Computer Science 2021-03-25 Beici Liang , György Fazekas , Mark Sandler

We introduce a structure-aware approach for symbolic piano accompaniment that decouples high-level planning from note-level realization. A lightweight transformer predicts an interpretable, per-measure style plan conditioned on…

Sound · Computer Science 2026-02-18 Wanyu Zang , Yang Yu , Meng Yu

Automatic music transcription (AMT) has achieved high accuracy for piano due to the availability of large, high-quality datasets such as MAESTRO and MAPS, but comparable datasets are not yet available for other instruments. In recent work,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-26 Xavier Riley , Drew Edwards , Simon Dixon

Many applications of cross-modal music retrieval are related to connecting sheet music images to audio recordings. A typical and recent approach to this is to learn, via deep neural networks, a joint embedding space that correlates short…

Sound · Computer Science 2023-09-22 Luis Carvalho , Gerhard Widmer

In deep learning research, many melody extraction models rely on redesigning neural network architectures to improve performance. In this paper, we propose an input feature modification and a training objective modification based on two…

Sound · Computer Science 2023-08-08 Keren Shao , Ke Chen , Taylor Berg-Kirkpatrick , Shlomo Dubnov

This paper aims to develop a holistic evaluation method for piano sound quality to assist in purchasing decisions. Unlike previous studies that focused on the effect of piano performance techniques on sound quality, this study evaluates the…

Sound · Computer Science 2025-04-22 Monan Zhou , Shangda Wu , Shaohua Ji , Zijin Li , Wei Li

Current models for audio--sheet music retrieval via multimodal embedding space learning use convolutional neural networks with a fixed-size window for the input audio. Depending on the tempo of a query performance, this window captures more…

Sound · Computer Science 2018-09-18 Matthias Dorfer , Jan Hajič , Gerhard Widmer

Most work on musical score models (a.k.a. musical language models) for music transcription has focused on describing the local sequential dependence of notes in musical scores and failed to capture their global repetitive structure, which…

Sound · Computer Science 2021-02-17 Eita Nakamura , Kazuyoshi Yoshii

Automatic music transcription (AMT) has achieved remarkable progress for instruments such as the piano, largely due to the availability of large-scale, high-quality datasets. In contrast, violin AMT remains underexplored due to limited…

Sound · Computer Science 2025-08-21 Yueh-Po Peng , Ting-Kang Wang , Li Su , Vincent K. M. Cheung

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade

This paper presents a statistical method for use in music transcription that can estimate score times of note onsets and offsets from polyphonic MIDI performance signals. Because performed note durations can deviate largely from…

Artificial Intelligence · Computer Science 2017-07-10 Eita Nakamura , Kazuyoshi Yoshii , Simon Dixon

Directly learning to generate audio waveforms in an autoregressive manner is a challenging task, due to the length of the raw sequences and the existence of important structure on many different timescales. Traditional approaches based on…

Sound · Computer Science 2025-10-06 Konrad Szewczyk , Daniel Gallo Fernández , James Townsend

Non-autoregressive models greatly improve decoding speed over typical sequence-to-sequence models, but suffer from degraded performance. Infilling and iterative refinement models make up some of this gap by editing the outputs of a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-28 Ethan A. Chi , Julian Salazar , Katrin Kirchhoff

Existing methods for expressive music performance rendering rely on supervised learning over small labeled datasets, which limits scaling of both data volume and model size, despite the availability of vast unlabeled music, as in vision and…

Sound · Computer Science 2025-12-03 Hong-Jie You , Jie-Jing Shao , Xiao-Wen Yang , Lin-Han Jia , Lan-Zhe Guo , Yu-Feng Li

Motivated by the state-of-art psychological research, we note that a piano performance transcribed with existing Automatic Music Transcription (AMT) methods cannot be successfully resynthesized without affecting the artistic content of the…

Sound · Computer Science 2026-01-21 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

While piano music transcription models have shown high performance for solo piano recordings, their performance degrades when applied to ensemble recordings. This study aims to analyze the impact of different data augmentation methods on…

Sound · Computer Science 2023-05-24 Hyemi Kim , Jiyun Park , Taegyun Kwon , Dasaem Jeong , Juhan Nam

Most of the state-of-the-art automatic music transcription (AMT) models break down the main transcription task into sub-tasks such as onset prediction and offset prediction and train them with onset and offset labels. These predictions are…

Sound · Computer Science 2020-10-21 Kin Wai Cheuk , Yin-Jyun Luo , Emmanouil Benetos , Dorien Herremans

We show that pre-training a Transformer on music before language significantly accelerates language acquisition. Using piano performances (MAESTRO dataset), a developmental pipeline -- music $\to$ poetry $\to$ prose -- yields a $17.5\%$…

Computation and Language · Computer Science 2026-04-24 Yoshinori Nomura