English
Related papers

Related papers: Frame-level Instrument Recognition by Timbre and P…

200 papers

Machine learning techniques nowadays play a vital role in many burning issues of real-world problems when it involves data. In addition, when the task is complex, people are in dilemma in choosing deep learning techniques or going without…

Sound · Computer Science 2021-05-14 V. N. Aditya Datta Chivukula , Rupaj Kumar Nayak

Pitch detection is a fundamental problem in speech processing as F0 is used in a large number of applications. Recent articles have proposed deep learning for robust pitch tracking. In this paper, we consider voicing detection as a…

Sound · Computer Science 2019-03-06 Thomas Drugman , Goeric Huybrechts , Viacheslav Klimkov , Alexis Moinet

At present, neural network-based models, including transformers, struggle to generate memorable and readily comprehensible music from unified and repetitive musical material due to a lack of understanding of musical structure. Consequently,…

Sound · Computer Science 2026-01-21 Shangxuan Luo , Joshua Reiss

Music is a form of expression that often requires interaction between players. If one wishes to interact in such a musical way with a computer, it is necessary for the machine to be able to interpret the input given by the human to find its…

Sound · Computer Science 2022-09-01 Filippo Carnovalini , Antonio Rodà

Current ML models for music emotion recognition, while generally working quite well, do not give meaningful or intuitive explanations for their predictions. In this work, we propose a 2-step procedure to arrive at spectrogram-level…

Sound · Computer Science 2019-05-29 Verena Haunschmid , Shreyan Chowdhury , Gerhard Widmer

The increased presence of advanced sensors on the production floors has led to the collection of datasets that can provide significant insights into machine health. An important and reliable indicator of machine health, vibration signal…

Signal Processing · Electrical Eng. & Systems 2021-02-04 Rishikesh Magar , Lalit Ghule , Junhan Li , Yang Zhao , Amir Barati Farimani

Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality itself, e.g., as sequences of symbolic notes. This observation…

Sound · Computer Science 2025-09-30 Junyan Jiang , Daniel Chin , Liwei Lin , Xuanjie Liu , Gus Xia

In this paper we describe an approach to identify the name of a piece of piano music, based on a short audio excerpt of a performance. Given only a description of the pieces in text format (i.e. no score information is provided), a…

Information Retrieval · Computer Science 2017-08-03 Andreas Arzt , Gerhard Widmer

Spectral envelope is one of the most important features that characterize the timbre of an instrument sound. However, it is difficult to use spectral information in the framework of conventional spectrogram decomposition methods. We…

Sound · Computer Science 2018-01-15 Jeongsoo Park , Jaeyoung Shin , Kyogu Lee

Instrumental playing techniques such as vibratos, glissandos, and trills often denote musical expressivity, both in classical and folk contexts. However, most existing approaches to music similarity retrieval fail to describe timbre beyond…

Saliency detection with light field images is becoming attractive given the abundant cues available, however, this comes at the expense of large-scale pixel level annotated data which is expensive to generate. In this paper, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Mingtao Feng , Kendong Liu , Liang Zhang , Hongshan Yu , Yaonan Wang , Ajmal Mian

We explore frame-level audio feature learning for chord recognition using artificial neural networks. We present the argument that chroma vectors potentially hold enough information to model harmonic content of audio for chord recognition,…

Sound · Computer Science 2016-12-16 Filip Korzeniowski , Gerhard Widmer

The task of estimating the fundamental frequency of a monophonic sound recording, also known as pitch tracking, is fundamental to audio processing with multiple applications in speech processing and music information retrieval. To date, the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-20 Jong Wook Kim , Justin Salamon , Peter Li , Juan Pablo Bello

Music tag words that describe music audio by text have different levels of abstraction. Taking this issue into account, we propose a music classification approach that aggregates multi-level and multi-scale features using pre-trained…

Sound · Computer Science 2017-06-22 Jongpil Lee , Juhan Nam

The original ImageNet benchmark enforces a single-label assumption, despite many images depicting multiple objects. This leads to label noise and limits the richness of the learning signal. Multi-label annotations more accurately reflect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Junyu Chen , Md Yousuf Harun , Christopher Kanan

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The…

Machine Learning · Statistics 2016-02-12 Siddharth Sigtia , Emmanouil Benetos , Simon Dixon

The assessment of music performances in most cases takes into account the underlying musical score being performed. While there have been several automatic approaches for objective music performance assessment (MPA) based on extracted…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Jiawen Huang , Yun-Ning Hung , Ashis Pati , Siddharth Kumar Gururani , Alexander Lerch

This article presents a benchmark study of symbolic piano music classification using the masked language modelling approach of the Bidirectional Encoder Representations from Transformers (BERT). Specifically, we consider two types of MIDI…

Sound · Computer Science 2024-04-16 Yi-Hui Chou , I-Chun Chen , Chin-Jui Chang , Joann Ching , Yi-Hsuan Yang

Extraction of the predominant pitch from polyphonic audio is one of the fundamental tasks in the field of music information retrieval and computational musicology. To accomplish this task using machine learning, a large amount of labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-07 Kavya Ranjan Saxena , Vipul Arora

In this paper, we introduce a simple method that can separate arbitrary musical instruments from an audio mixture. Given an unaligned MIDI transcription for a target instrument from an input mixture, we synthesize new mixtures from the midi…

Sound · Computer Science 2020-09-30 Ethan Manilow , Bryan Pardo