English
Related papers

Related papers: End-to-end Piano Performance-MIDI to Score Convers…

200 papers

The majority of recent progress in Optical Music Recognition (OMR) has been achieved with Deep Learning methods, especially models following the end-to-end paradigm, reading input images and producing a linear sequence of tokens.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Jiří Mayer , Milan Straka , Jan Hajič , Pavel Pecina

We introduce a structure-aware approach for symbolic piano accompaniment that decouples high-level planning from note-level realization. A lightweight transformer predicts an interpretable, per-measure style plan conditioned on…

Sound · Computer Science 2026-02-18 Wanyu Zang , Yang Yu , Meng Yu

Rhythm transcription is a key subtask of notation-level Automatic Music Transcription (AMT). While deep learning models have been extensively used for detecting the metrical grid in audio and MIDI performances, beat-based rhythm…

Sound · Computer Science 2026-04-27 Maximilian Wachter , Sebastian Murgul , Michael Heizmann

Robot musicians require precise control to obtain proper note accuracy, sound quality, and musical expression. Performance of string instruments, such as violin and cello, presents a significant challenge due to the precise control required…

Optical Music Recognition (OMR) has made significant progress since its inception, with various approaches now capable of accurately transcribing music scores into digital formats. Despite these advancements, most so-called end-to-end OMR…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Antonio Ríos-Vila , Jorge Calvo-Zaragoza , David Rizo , Thierry Paquet

In recent years, deep learning has achieved formidable results in creative computing. When it comes to music, one viable model for music generation are Transformer based models. However, while transformers models are popular for music…

Sound · Computer Science 2024-10-15 Gabriel Souza , Flavio Figueiredo , Alexei Machado , Deborah Guimarães

This paper approaches the problem of separating the notes from a quantized symbolic music piece (e.g., a MIDI file) into multiple voices and staves. This is a fundamental part of the larger task of music score engraving (or score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-01 Francesco Foscarin , Emmanouil Karystinaios , Eita Nakamura , Gerhard Widmer

State-of-the-art end-to-end Optical Music Recognition (OMR) has, to date, primarily been carried out using monophonic transcription techniques to handle complex score layouts, such as polyphony, often by resorting to simplifications or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Antonio Ríos-Vila , Jorge Calvo-Zaragoza , Thierry Paquet

Although a variety of transformers have been proposed for symbolic music generation in recent years, there is still little comprehensive study on how specific design choices affect the quality of the generated music. In this work, we…

Most recent research about automatic music transcription (AMT) uses convolutional neural networks and recurrent neural networks to model the mapping from music signals to symbolic notation. Based on a high-resolution piano transcription…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Longshen Ou , Ziyi Guo , Emmanouil Benetos , Jiqing Han , Ye Wang

Research on style transfer and domain translation has clearly demonstrated the ability of deep learning-based algorithms to manipulate images in terms of artistic style. More recently, several attempts have been made to extend such…

Sound · Computer Science 2021-06-11 Ondřej Cífka , Umut Şimşekli , Gaël Richard

Even with strong sequence models like Transformers, generating expressive piano performances with long-range musical structures remains challenging. Meanwhile, methods to compose well-structured melodies or lead sheets (melody + chords),…

Sound · Computer Science 2023-03-08 Shih-Lun Wu , Yi-Hsuan Yang

This paper describes a streaming audio-to-MIDI piano transcription approach that aims to sequentially translate a music signal into a sequence of note onset and offset events. The sequence-to-sequence nature of this task may call for the…

Sound · Computer Science 2025-03-04 Weixing Wei , Jiahao Zhao , Yulun Wu , Kazuyoshi Yoshii

Musical expression requires control of both what notes are played, and how they are performed. Conventional audio synthesizers provide detailed expressive controls, but at the cost of realism. Black-box neural audio synthesis and…

This thesis develops a Transformer model based on Whisper, which extracts melodies and chords from music audio and records them into ABC notation. A comprehensive data processing workflow is customized for ABC notation, including data…

Sound · Computer Science 2024-10-23 Hongyao Zhang , Bohang Sun

Expert musicians can mould a musical piece to convey specific emotions that they intend to communicate. In this paper, we place a mid-level features based music emotion model in this performer-to-listener communication scenario, and…

Sound · Computer Science 2023-03-06 Shreyan Chowdhury , Gerhard Widmer

Performance-score synchronization is an integral task in signal processing, which entails generating an accurate mapping between an audio recording of a performance and the corresponding musical score. Traditional synchronization methods…

Sound · Computer Science 2022-04-20 Ruchit Agrawal , Daniel Wolff , Simon Dixon

We propose a transformer-based rhythm quantization model that incorporates beat and downbeat information to quantize MIDI performances into metrically-aligned, human-readable scores. We propose a beat-based preprocessing method that…

Sound · Computer Science 2025-08-28 Maximilian Wachter , Sebastian Murgul , Michael Heizmann

This project presents an AI-based system for tone replication in music production, focusing on predicting EQ parameter settings directly from audio features. Unlike traditional audio-to-audio methods, our approach outputs interpretable…

Sound · Computer Science 2025-09-30 Song-Ze Yu

We present a statistical-modelling method for piano reduction, i.e. converting an ensemble score into piano scores, that can control performance difficulty. While previous studies have focused on describing the condition for playable piano…

Artificial Intelligence · Computer Science 2018-10-26 Eita Nakamura , Kazuyoshi Yoshii