English
Related papers

Related papers: Multitask Learning for Polyphonic Piano Transcript…

200 papers

This paper approaches the problem of separating the notes from a quantized symbolic music piece (e.g., a MIDI file) into multiple voices and staves. This is a fundamental part of the larger task of music score engraving (or score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-01 Francesco Foscarin , Emmanouil Karystinaios , Eita Nakamura , Gerhard Widmer

Recent years have witnessed a growing interest in research related to the detection of piano pedals from audio signals in the music information retrieval community. However, to our best knowledge, recent generative models for symbolic music…

Sound · Computer Science 2021-11-03 Joann Ching , Yi-Hsuan Yang

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

Computation and Language · Computer Science 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Many music theoretical constructs (such as scale types, modes, cadences, and chord types) are defined in terms of pitch intervals---relative distances between pitches. Therefore, when computer models are employed in music tasks, it can be…

Sound · Computer Science 2019-02-05 Stefan Lattner , Maarten Grachten , Gerhard Widmer

When writing programs, people have the ability to tackle a new complex task by decomposing it into smaller and more familiar subtasks. While it is difficult to measure whether neural program synthesis methods have similar capabilities, what…

Machine Learning · Computer Science 2023-10-31 Kensen Shi , Joey Hong , Manzil Zaheer , Pengcheng Yin , Charles Sutton

Multinomial Logistic Regression is a well-studied tool for classification and has been widely used in fields like image processing, computer vision and, bioinformatics, to name a few. Under a supervised classification scenario, a…

Machine Learning · Statistics 2020-02-24 R. Jyothi , P. Babu

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Lyrics transcription of polyphonic music is challenging not only because the singing vocals are corrupted by the background music, but also because the background music and the singing style vary across music genres, such as pop, metal, and…

Sound · Computer Science 2022-04-08 Xiaoxue Gao , Chitralekha Gupta , Haizhou Li

According to the principle of compositional generalization, the meaning of a complex expression can be understood as a function of the meaning of its parts and of how they are combined. This principle is crucial for human language…

Computation and Language · Computer Science 2024-03-19 Sungjun Han , Sebastian Padó

Music performance synthesis aims to synthesize a musical score into a natural performance. In this paper, we borrow recent advances in text-to-speech synthesis and present the Deep Performer -- a novel system for score-to-audio music…

Sound · Computer Science 2022-02-22 Hao-Wen Dong , Cong Zhou , Taylor Berg-Kirkpatrick , Julian McAuley

This paper provides a detailed analysis of the NeuroPiano dataset, which comprise 104 audio recordings of student piano performances accompanied with 2255 textual feedback and ratings given by professional pianists. We offer a statistical…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-07 Huan Zhang , Vincent Cheung , Hayato Nishioka , Simon Dixon , Shinichi Furuya

Transfer learning is a crucial concept within deep learning that allows artificial neural networks to benefit from a large pre-training data basis when confronted with a task of limited data. Despite its ubiquitous use and clear benefits,…

Machine Learning · Computer Science 2026-05-20 Manuel Milling , Andreas Triantafyllopoulos , Alexander Gebhard , Simon Rampp , Björn W. Schuller

We propose Polyffusion, a diffusion model that generates polyphonic music scores by regarding music as image-like piano roll representations. The model is capable of controllable music generation with two paradigms: internal control and…

Sound · Computer Science 2023-07-21 Lejun Min , Junyan Jiang , Gus Xia , Jingwei Zhao

This paper presents the results of the 2025 Automatic Music Transcription (AMT) Challenge, an online competition to benchmark progress in multi-instrument transcription. Eight teams submitted valid solutions; two outperformed the baseline…

This work addresses the problem of matching short excerpts of audio with their respective counterparts in sheet music images. We show how to employ neural network-based cross-modality embedding spaces for solving the following two sheet…

Information Retrieval · Computer Science 2017-08-01 Matthias Dorfer , Andreas Arzt , Gerhard Widmer

In this study, we develop a method for multi-task manifold learning. The method aims to improve the performance of manifold learning for multiple tasks, particularly when each task has a small number of samples. Furthermore, the method also…

Machine Learning · Computer Science 2021-11-25 Hideaki Ishibashi , Kazushi Higa , Tetsuo Furukawa

Recently multimodal transformer models have gained popularity because their performance on language and vision tasks suggest they learn rich visual-linguistic representations. Focusing on zero-shot image retrieval tasks, we study three…

Computation and Language · Computer Science 2021-02-02 Lisa Anne Hendricks , John Mellor , Rosalia Schneider , Jean-Baptiste Alayrac , Aida Nematzadeh

Pretrained Transformer based models finetuned on domain specific corpora have changed the landscape of NLP. Generally, if one has multiple tasks on a given dataset, one may finetune different models or use task specific adapters. In this…

The compositional generalization abilities of neural models have been sought after for human-like linguistic competence. The popular method to evaluate such abilities is to assess the models' input-output behavior. However, that does not…

Computation and Language · Computer Science 2025-02-24 Ryoma Kumon , Hitomi Yanaka

Ambiguities in data and problem constraints can lead to diverse, equally plausible outcomes for a machine learning task. In beat and downbeat tracking, for instance, different listeners may adopt various rhythmic interpretations, none of…

Sound · Computer Science 2025-10-30 Antonin Gagnere , Slim Essid , Geoffroy Peeters