English
Related papers

Related papers: Frame-level Instrument Recognition by Timbre and P…

200 papers

This work addresses the problem of matching short excerpts of audio with their respective counterparts in sheet music images. We show how to employ neural network-based cross-modality embedding spaces for solving the following two sheet…

Information Retrieval · Computer Science 2017-08-01 Matthias Dorfer , Andreas Arzt , Gerhard Widmer

Recently, some single-step systems without onset detection have shown their effectiveness in automatic musical tempo estimation. Following the success of these systems, in this paper we propose a Multi-scale Grouped Attention Network to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-06 Xiaoheng Sun , Qiqi He , Yongwei Gao , Wei Li

Extraction of symbolic information from signals is an active field of research enabling numerous applications especially in the Musical Information Retrieval domain. This complex task, that is also related to other topics such as pitch…

This paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research. The features include musical elements like key, downbeats, and genre, as well as audio…

Sound · Computer Science 2025-08-08 Anuradha Chopra , Abhinaba Roy , Dorien Herremans

Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for…

Sound · Computer Science 2025-04-23 Yifu Sun , Xulong Zhang , Monan Zhou , Wei Li

Automatic Music Transcription (AMT), inferring musical notes from raw audio, is a challenging task at the core of music understanding. Unlike Automatic Speech Recognition (ASR), which typically focuses on the words of a single speaker, AMT…

Sound · Computer Science 2022-03-16 Josh Gardner , Ian Simon , Ethan Manilow , Curtis Hawthorne , Jesse Engel

Constructing an embedding space for musical instrument sounds that can meaningfully represent new and unseen instruments is important for downstream music generation tasks such as multi-instrument synthesis and timbre transfer. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-28 Xuan Shi , Erica Cooper , Junichi Yamagishi

This paper explores a specific sub-task of cross-modal music retrieval. We consider the delicate task of retrieving a performance or rendition of a musical piece based on a description of its style, expressive character, or emotion from a…

Sound · Computer Science 2024-01-29 Shreyan Chowdhury , Gerhard Widmer

This paper presents a method for large-scale retrieval of piano sheet music images. Our work differs from previous studies on sheet music retrieval in two ways. First, we investigate the problem at a much larger scale than previous studies,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Daniel Yang , TJ Tsai

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

Symbolic music understanding, which refers to the understanding of music from the symbolic data (e.g., MIDI format, but not audio), covers many music applications such as genre classification, emotion classification, and music pieces…

Sound · Computer Science 2021-06-11 Mingliang Zeng , Xu Tan , Rui Wang , Zeqian Ju , Tao Qin , Tie-Yan Liu

The online estimation of rhythmic information, such as beat positions, downbeat positions, and meter, is critical for many real-time music applications. Musical rhythm comprises complex hierarchical relationships across time, rendering its…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-10 Mojtaba Heydari , Frank Cwitkowitz , Zhiyao Duan

The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introduces PianoVAM, a comprehensive piano performance dataset that…

Sound · Computer Science 2025-09-11 Yonghyun Kim , Junhyung Park , Joonhyung Bae , Kirak Kim , Taegyun Kwon , Alexander Lerch , Juhan Nam

We propose a novel approach for the automatic equalization of individual musical instrument tracks. Our method begins by identifying the instrument present within a source recording in order to choose its corresponding ideal spectrum as a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-24 Florian Mockenhaupt , Joscha Simon Rieber , Shahan Nercessian

Guitar tablatures enrich the structure of traditional music notation by assigning each note to a string and fret of a guitar in a particular tuning, indicating precisely where to play the note on the instrument. The problem of generating…

Sound · Computer Science 2024-08-12 Drew Edwards , Xavier Riley , Pedro Sarmento , Simon Dixon

A data set of recorded single played tones of a concert grand piano is investigated using Machine Learning (ML) on psychoacoustic timbre features. The examined instrument has been recorded at two stages: firstly right after manufacture and…

Neurons and Cognition · Quantitative Biology 2021-12-17 Niko Plath , Rolf Bader

In this paper we introduce multi-label ferns, and apply this technique for automatic classification of musical instruments in audio recordings. We compare the performance of our proposed method to a set of binary random ferns, using jazz…

Machine Learning · Computer Science 2014-04-01 Miron B. Kursa , Alicja A. Wieczorkowska

Large audio language models are increasingly used for complex audio understanding tasks, but they struggle with temporal tasks that require precise temporal grounding, such as word alignment and speaker diarization. The standard approach,…

Machine Learning · Computer Science 2026-02-12 Joesph An , Phillip Keung , Jiaqi Wang , Orevaoghene Ahia , Noah A. Smith

Automatically estimating the performance difficulty of a music piece represents a key process in music education to create tailored curricula according to the individual needs of the students. Given its relevance, the Music Information…

Sound · Computer Science 2025-05-30 Pedro Ramoneda , Minhee Lee , Dasaem Jeong , J. J. Valero-Mas , Xavier Serra

The work of a single musician, group or composer can vary widely in terms of musical style. Indeed, different stylistic elements, from performance medium and rhythm to harmony and texture, are typically exploited and developed across an…

Sound · Computer Science 2017-12-11 Sergey Shuvaev , Hamza Giaffar , Alexei A. Koulakov