English
Related papers

Related papers: Onsets and Frames: Dual-Objective Piano Transcript…

200 papers

We propose a deep learning approach to predicting audio event onsets in electroencephalogram (EEG) recorded from users as they listen to music. We use a publicly available dataset containing ten contemporary songs and concurrently recorded…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Ashvala Vinay , Alexander Lerch , Grace Leslie

Capturing intricate and subtle variations in human expressiveness in music performance using computational approaches is challenging. In this paper, we propose a novel approach for reconstructing human expressiveness in piano performance…

Sound · Computer Science 2023-10-03 Jingjing Tang , Geraint Wiggins , Gyorgy Fazekas

Multi-pitch estimation is a decades-long research problem involving the detection of pitch activity associated with concurrent musical events within multi-instrument mixtures. Supervised learning techniques have demonstrated solid…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-27 Frank Cwitkowitz , Zhiyao Duan

Annotating musical beats is a very long and tedious process. In order to combat this problem, we present a new self-supervised learning pretext task for beat tracking and downbeat estimation. This task makes use of Spleeter, an audio source…

Sound · Computer Science 2023-07-18 Dorian Desblancs

Acoustic events often have a visual counterpart. Knowledge of visual information can aid the understanding of complex auditory scenes, even when only a stereo mixdown is available in the audio domain, \eg identifying which musicians are…

Neural and Evolutionary Computing · Computer Science 2017-06-30 A. Bazzica , J. C. van Gemert , C. C. S. Liem , A. Hanjalic

In deep learning research, many melody extraction models rely on redesigning neural network architectures to improve performance. In this paper, we propose an input feature modification and a training objective modification based on two…

Sound · Computer Science 2023-08-08 Keren Shao , Ke Chen , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Detecting piano pedalling techniques in polyphonic music remains a challenging task in music information retrieval. While other piano-related tasks, such as pitch estimation and onset detection, have seen improvement through applying deep…

Sound · Computer Science 2021-03-25 Beici Liang , György Fazekas , Mark Sandler

Most work on musical score models (a.k.a. musical language models) for music transcription has focused on describing the local sequential dependence of notes in musical scores and failed to capture their global repetitive structure, which…

Sound · Computer Science 2021-02-17 Eita Nakamura , Kazuyoshi Yoshii

A recurrent Neural Network (RNN) is trained to predict sound samples based on audio input augmented by control parameter information for pitch, volume, and instrument identification. During the generative phase following training, audio…

Sound · Computer Science 2019-03-27 Lonce Wyse , Muhammad Huzaifah

Automatic music transcription (AMT) has achieved high accuracy for piano due to the availability of large, high-quality datasets such as MAESTRO and MAPS, but comparable datasets are not yet available for other instruments. In recent work,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-26 Xavier Riley , Drew Edwards , Simon Dixon

We revisit the problems of pitch spelling and tonality guessing with a new algorithm for their joint estimation from a MIDI file including information about the measure boundaries. Our algorithm does not only identify a global key but also…

Sound · Computer Science 2024-02-19 Augustin Bouquillard , Florent Jacquemard

Most of the state-of-the-art automatic music transcription (AMT) models break down the main transcription task into sub-tasks such as onset prediction and offset prediction and train them with onset and offset labels. These predictions are…

Sound · Computer Science 2020-10-21 Kin Wai Cheuk , Yin-Jyun Luo , Emmanouil Benetos , Dorien Herremans

Advances in neural network design and the availability of large-scale labeled datasets have driven major improvements in piano transcription. Existing approaches target either offline applications, with no restrictions on computational…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Patricia Hu , Silvan David Peter , Jan Schlüter , Gerhard Widmer

Recent directions in automatic speech recognition (ASR) research have shown that applying deep learning models from image recognition challenges in computer vision is beneficial. As automatic music transcription (AMT) is superficially…

Sound · Computer Science 2022-02-07 Carl Thomé , Sven Ahlbäck

Identifying musical instruments in polyphonic music recordings is a challenging but important problem in the field of music information retrieval. It enables music search by instrument, helps recognize musical genres, or can make music…

Sound · Computer Science 2016-12-28 Yoonchang Han , Jaehun Kim , Kyogu Lee

Automatic piano transcription models are typically evaluated using simple frame- or note-wise information retrieval (IR) metrics. Such benchmark metrics do not provide insights into the transcription quality of specific musical aspects such…

Sound · Computer Science 2024-10-10 Patricia Hu , Lukáš Samuel Marták , Carlos Cancino-Chacón , Gerhard Widmer

How can we process a piece of recorded music to detect and visualize the onset of each instrument? A simple, interpretable approach is based on partially fixed nonnegative matrix factorization (NMF). Yet despite the method's simplicity,…

Numerical Analysis · Mathematics 2026-01-16 Alisha L. Foster , Robert J. Webber

Automatic Music Transcription, which consists in transforming an audio recording of a musical performance into symbolic format, remains a difficult Music Information Retrieval task. In this work, which focuses on piano transcription, we…

Sound · Computer Science 2022-04-15 Haoran Wu , Axel Marmoret , Jérémy E. Cohen

Diffusion models have been widely used in the generative domain due to their convincing performance in modeling complex data distributions. Moreover, they have shown competitive results on discriminative tasks, such as image segmentation.…

Sound · Computer Science 2025-01-14 Hounsu Kim , Taegyun Kwon , Juhan Nam

Motivated by the state-of-art psychological research, we note that a piano performance transcribed with existing Automatic Music Transcription (AMT) methods cannot be successfully resynthesized without affecting the artistic content of the…

Sound · Computer Science 2026-01-21 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini