English
Related papers

Related papers: MT3: Multi-Task Multitrack Music Transcription

200 papers

Automatic Music Transcription (AMT) converts audio recordings into symbolic musical representations. Training deep neural networks (DNNs) for AMT typically requires strongly aligned training pairs with precise frame-level annotations. Since…

Sound · Computer Science 2025-11-19 Jonathan Yaffe , Ben Maman , Meinard Müller , Amit H. Bermano

Audio-to-score alignment (A2SA) is a multimodal task consisting in the alignment of audio signals to music scores. Recent literature confirms the benefits of Automatic Music Transcription (AMT) for A2SA at the frame-level. In this work, we…

Sound · Computer Science 2022-01-03 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

Automatic music transcription (AMT) aims to infer a latent symbolic representation of a piece of music (piano-roll), given a corresponding observed audio recording. Transcribing polyphonic music (when multiple notes are played…

Machine Learning · Statistics 2018-11-19 Pablo A. Alvarado , Dan Stowell

Most of the current supervised automatic music transcription (AMT) models lack the ability to generalize. This means that they have trouble transcribing real-world music recordings from diverse musical genres that are not presented in the…

Sound · Computer Science 2021-07-30 Kin Wai Cheuk , Dorien Herremans , Li Su

Automatic music transcription (AMT) has achieved high accuracy for piano due to the availability of large, high-quality datasets such as MAESTRO and MAPS, but comparable datasets are not yet available for other instruments. In recent work,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-26 Xavier Riley , Drew Edwards , Simon Dixon

We investigate the problem of incorporating higher-level symbolic score-like information into Automatic Music Transcription (AMT) systems to improve their performance. We use recurrent neural networks (RNNs) and their variants as music…

We present a framework based on neural networks to extract music scores directly from polyphonic audio in an end-to-end fashion. Most previous Automatic Music Transcription (AMT) methods seek a piano-roll representation of the pitches, that…

Sound · Computer Science 2019-10-29 Miguel A. Román , Antonio Pertusa , Jorge Calvo-Zaragoza

Automatic Music Transcription (AMT), aiming to get musical notes from raw audio, typically uses frame-level systems with piano-roll outputs or language model (LM)-based systems with note-level predictions. However, frame-level systems…

Sound · Computer Science 2025-01-08 Dichucheng Li , Yongyi Zang , Qiuqiang Kong

Automatic Music Transcription (AMT) has advanced significantly for the piano, but transcription for the guitar remains limited due to several key challenges. Existing systems fail to detect and annotate expressive techniques (e.g., slides,…

Recently, Transformers have been introduced into the field of acoustics recognition. They are pre-trained on large-scale datasets using methods such as supervised learning and semi-supervised learning, demonstrating robust generality--It…

Sound · Computer Science 2024-01-22 Yun Liang , Hai Lin , Shaojian Qiu , Yihang Zhang

Representing symbolic music with compound tokens, where each token consists of several different sub-tokens representing a distinct musical feature or attribute, offers the advantage of reducing sequence length. While previous research has…

Sound · Computer Science 2026-03-17 HaeJun Yoo , Hao-Wen Dong , Jongmin Jung , Dasaem Jeong

Motivated by the state-of-art psychological research, we note that a piano performance transcribed with existing Automatic Music Transcription (AMT) methods cannot be successfully resynthesized without affecting the artistic content of the…

Sound · Computer Science 2026-01-21 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

Deep learning models define the state-of-the-art in Automatic Drum Transcription (ADT), yet their performance is contingent upon large-scale, paired audio-MIDI datasets, which are scarce. Existing workarounds that use synthetic data often…

Sound · Computer Science 2026-01-15 Pierfrancesco Melucci , Paolo Merialdo , Taketo Akama

Automatic Music Transcription (AMT) is the task of recognizing notes in audio recordings of music. The State-of-the-Art (SotA) benchmarks have been dominated by deep learning systems. Due to the scarcity of high quality data, they are…

Sound · Computer Science 2024-08-12 Lukáš Samuel Marták , Patricia Hu , Gerhard Widmer

We propose a framework for audio-to-score alignment on piano performance that employs automatic music transcription (AMT) using neural networks. Even though the AMT result may contain some errors, the note prediction output can be regarded…

Sound · Computer Science 2017-11-15 Taegyun Kwon , Dasaem Jeong , Juhan Nam

Recently, multi-instrument music generation has become a hot topic. Different from single-instrument generation, multi-instrument generation needs to consider inter-track harmony besides intra-track coherence. This is usually achieved by…

Sound · Computer Science 2023-05-29 Xipin Wei , Junhui Chen , Zirui Zheng , Li Guo , Lantian Li , Dong Wang

Automatic music transcription (AMT) has achieved remarkable progress for instruments such as the piano, largely due to the availability of large-scale, high-quality datasets. In contrast, violin AMT remains underexplored due to limited…

Sound · Computer Science 2025-08-21 Yueh-Po Peng , Ting-Kang Wang , Li Su , Vincent K. M. Cheung

This study focuses on the perception of music performances when contextual factors, such as room acoustics and instrument, change. We propose to distinguish the concept of "performance" from the one of "interpretation", which expresses the…

Sound · Computer Science 2022-03-08 Federico Simonetta , Federico Avanzini , Stavros Ntalampiras

This paper describes an automatic drum transcription (ADT) method that directly estimates a tatum-level drum score from a music signal, in contrast to most conventional ADT methods that estimate the frame-level onset probabilities of drums.…

Sound · Computer Science 2021-05-13 Ryoto Ishizuka , Ryo Nishikimi , Kazuyoshi Yoshii

The state-of-the-art methods for drum transcription in the presence of melodic instruments (DTM) are machine learning models trained in a supervised manner, which means that they rely on labeled datasets. The problem is that the available…

Sound · Computer Science 2021-11-24 Mickael Zehren , Marco Alunno , Paolo Bientinesi