English
Related papers

Related papers: Polyphonic Piano Transcription Using Autoregressiv…

200 papers

Motivated by the state-of-art psychological research, we note that a piano performance transcribed with existing Automatic Music Transcription (AMT) methods cannot be successfully resynthesized without affecting the artistic content of the…

Sound · Computer Science 2026-01-21 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings. The translation-invariant network discussed in this paper, which combines a…

Machine Learning · Statistics 2017-11-15 John Thickstun , Zaid Harchaoui , Dean Foster , Sham M. Kakade

In recent years, research on music transcription has focused mainly on architecture design and instrument-specific data acquisition. With the lack of availability of diverse datasets, progress is often limited to solo-instrument tasks such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-25 Frank Cwitkowitz , Kin Wai Cheuk , Woosung Choi , Marco A. Martínez-Ramírez , Keisuke Toyama , Wei-Hsiang Liao , Yuki Mitsufuji

For many music analysis problems, we need to know the presence of instruments for each time frame in a multi-instrument musical piece. However, such a frame-level instrument recognition task remains difficult, mainly due to the lack of…

Sound · Computer Science 2019-02-19 Yun-Ning Hung , Yi-An Chen , Yi-Hsuan Yang

In the realm of music AI, arranging rich and structured multi-track accompaniments from a simple lead sheet presents significant challenges. Such challenges include maintaining track cohesion, ensuring long-term coherence, and optimizing…

Sound · Computer Science 2024-11-26 Jingwei Zhao , Gus Xia , Ziyu Wang , Ye Wang

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

Recent advances in automatic music transcription (AMT) have achieved highly accurate polyphonic piano transcription results by incorporating onset and offset detection. The existing literature, however, focuses mainly on the leverage of…

Sound · Computer Science 2021-04-15 Kin Wai Cheuk , Yin-Jyun Luo , Emmanouil Benetos , Dorien Herremans

Automatic Music Transcription has seen significant progress in recent years by training custom deep neural networks on large datasets. However, these models have required extensive domain-specific design of network architectures,…

Sound · Computer Science 2021-07-21 Curtis Hawthorne , Ian Simon , Rigel Swavely , Ethan Manilow , Jesse Engel

In the domain of algorithmic music composition, machine learning-driven systems eliminate the need for carefully hand-crafting rules for composition. In particular, the capability of recurrent neural networks to learn complex temporal…

Sound · Computer Science 2019-03-05 Harish Kumar , Balaraman Ravindran

Automatic drum transcription, a subtask of the more general automatic music transcription, deals with extracting drum instrument note onsets from an audio source. Recently, progress in transcription performance has been made using…

Sound · Computer Science 2018-10-04 Richard Vogl , Gerhard Widmer , Peter Knees

We introduce a structure-aware approach for symbolic piano accompaniment that decouples high-level planning from note-level realization. A lightweight transformer predicts an interpretable, per-measure style plan conditioned on…

Sound · Computer Science 2026-02-18 Wanyu Zang , Yang Yu , Meng Yu

Non-autoregressive (NAR) neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. Under this framework, we leverage large monolingual corpora to improve the NAR model's performance, with the…

Computation and Language · Computer Science 2020-12-01 Jiawei Zhou , Phillip Keung

Multitrack music transcription aims to transcribe a music audio input into the musical notes of multiple instruments simultaneously. It is a very challenging task that typically requires a more complex model to achieve satisfactory result.…

Sound · Computer Science 2023-06-21 Wei-Tsung Lu , Ju-Chiang Wang , Yun-Ning Hung

In recent years, filterbank learning has become an increasingly popular strategy for various audio-related machine learning tasks. This is partly due to its ability to discover task-specific audio characteristics which can be leveraged in…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-14 Frank Cwitkowitz , Mojtaba Heydari , Zhiyao Duan

Poisson autoregressive count models have evolved into a time series staple for correlated count data. This paper proposes an alternative to Poisson autoregressions: count echo state networks. Echo state networks can be statistically…

Methodology · Statistics 2025-01-27 Qi Wang , Paul A. Parker , Robert B. Lund

Estimating piano dynamic from audio recordings is a fundamental challenge in computational music analysis. In this paper, we propose an efficient multi-task network that jointly predicts dynamic levels, change points, beats, and downbeats…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Zhanhong He , Hanyu Meng , David Huang , Roberto Togneri

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang

We introduce REPRISE, a REtrospective and PRospective Inference SchEme, which learns temporal event-predictive models of dynamical systems. REPRISE infers the unobservable contextual event state and accompanying temporal predictive models…

Machine Learning · Computer Science 2019-05-03 Martin V. Butz , David Bilkey , Dania Humaidan , Alistair Knott , Sebastian Otte

Multi-instrument Automatic Music Transcription (AMT), or the decoding of a musical recording into semantic musical content, is one of the holy grails of Music Information Retrieval. Current AMT approaches are restricted to piano and (some)…

Sound · Computer Science 2022-04-29 Ben Maman , Amit H. Bermano

In this work we present a new approach for the task of predicting fingerings for piano music. While prior neural approaches have often treated this as a sequence tagging problem with independent predictions, we put forward a checklist…

Machine Learning · Computer Science 2022-09-14 Nikita Srivatsan , Taylor Berg-Kirkpatrick