English
Related papers

Related papers: A Lightweight Instrument-Agnostic Model for Polyph…

200 papers

For many music analysis problems, we need to know the presence of instruments for each time frame in a multi-instrument musical piece. However, such a frame-level instrument recognition task remains difficult, mainly due to the lack of…

Sound · Computer Science 2019-02-19 Yun-Ning Hung , Yi-An Chen , Yi-Hsuan Yang

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The…

Machine Learning · Statistics 2016-02-12 Siddharth Sigtia , Emmanouil Benetos , Simon Dixon

Recent directions in automatic speech recognition (ASR) research have shown that applying deep learning models from image recognition challenges in computer vision is beneficial. As automatic music transcription (AMT) is superficially…

Sound · Computer Science 2022-02-07 Carl Thomé , Sven Ahlbäck

We propose a framework for audio-to-score alignment on piano performance that employs automatic music transcription (AMT) using neural networks. Even though the AMT result may contain some errors, the note prediction output can be regarded…

Sound · Computer Science 2017-11-15 Taegyun Kwon , Dasaem Jeong , Juhan Nam

Extracting pitch information from music recordings is a challenging but important problem in music signal processing. Frame-wise transcription or multi-pitch estimation aims for detecting the simultaneous activity of pitches in polyphonic…

Sound · Computer Science 2022-02-21 Christof Weiß , Geoffroy Peeters

Automatic drum transcription, a subtask of the more general automatic music transcription, deals with extracting drum instrument note onsets from an audio source. Recently, progress in transcription performance has been made using…

Sound · Computer Science 2018-10-04 Richard Vogl , Gerhard Widmer , Peter Knees

This paper presents the results of the 2025 Automatic Music Transcription (AMT) Challenge, an online competition to benchmark progress in multi-instrument transcription. Eight teams submitted valid solutions; two outperformed the baseline…

Most of the state-of-the-art automatic music transcription (AMT) models break down the main transcription task into sub-tasks such as onset prediction and offset prediction and train them with onset and offset labels. These predictions are…

Sound · Computer Science 2020-10-21 Kin Wai Cheuk , Yin-Jyun Luo , Emmanouil Benetos , Dorien Herremans

Most of the current supervised automatic music transcription (AMT) models lack the ability to generalize. This means that they have trouble transcribing real-world music recordings from diverse musical genres that are not presented in the…

Sound · Computer Science 2021-07-30 Kin Wai Cheuk , Dorien Herremans , Li Su

This paper makes several contributions to automatic lyrics transcription (ALT) research. Our main contribution is a novel variant of the Multistreaming Time-Delay Neural Network (MTDNN) architecture, called MSTRE-Net, which processes the…

Sound · Computer Science 2021-08-06 Emir Demirel , Sven Ahlbäck , Simon Dixon

Instrument recognition is a fundamental task in music information retrieval, yet little has been done to predict the presence of instruments in multi-instrument music for each time frame. This task is important for not only automatic…

Sound · Computer Science 2018-06-26 Yun-Ning Hung , Yi-Hsuan Yang

A central goal in automatic music transcription is to detect individual note events in music recordings. An important variant is instrument-dependent music transcription where methods can use calibration data for the instruments in use.…

Sound · Computer Science 2017-11-01 Sebastian Ewert , Mark B. Sandler

Multi-pitch estimation is a decades-long research problem involving the detection of pitch activity associated with concurrent musical events within multi-instrument mixtures. Supervised learning techniques have demonstrated solid…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-27 Frank Cwitkowitz , Zhiyao Duan

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

Multi-instrument music transcription aims to convert polyphonic music recordings into musical scores assigned to each instrument. This task is challenging for modeling as it requires simultaneously identifying multiple instruments and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-02 Sungkyun Chang , Emmanouil Benetos , Holger Kirchhoff , Simon Dixon

This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings. The translation-invariant network discussed in this paper, which combines a…

Machine Learning · Statistics 2017-11-15 John Thickstun , Zaid Harchaoui , Dean Foster , Sham M. Kakade

Recent advances in automatic music transcription (AMT) have achieved highly accurate polyphonic piano transcription results by incorporating onset and offset detection. The existing literature, however, focuses mainly on the leverage of…

Sound · Computer Science 2021-04-15 Kin Wai Cheuk , Yin-Jyun Luo , Emmanouil Benetos , Dorien Herremans

Automatic music transcription (AMT) has achieved high accuracy for piano due to the availability of large, high-quality datasets such as MAESTRO and MAPS, but comparable datasets are not yet available for other instruments. In recent work,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-26 Xavier Riley , Drew Edwards , Simon Dixon

While neural network models are making significant progress in piano transcription, they are becoming more resource-consuming due to requiring larger model size and more computing power. In this paper, we attempt to apply more prior about…

Sound · Computer Science 2022-09-01 Weixing Wei , Peilin Li , Yi Yu , Wei Li

This paper presents enhancements to the MT3 model, a state-of-the-art (SOTA) token-based multi-instrument automatic music transcription (AMT) model. Despite SOTA performance, MT3 has the issue of instrument leakage, where transcriptions are…

Sound · Computer Science 2024-03-18 Hao Hao Tan , Kin Wai Cheuk , Taemin Cho , Wei-Hsiang Liao , Yuki Mitsufuji