English
Related papers

Related papers: Polyphonic pitch detection with convolutional recu…

200 papers

Automatic Music Transcription (AMT) is one of the oldest and most well-studied problems in the field of music information retrieval. Within this challenging research field, onset detection and instrument recognition take important places in…

Machine Learning · Statistics 2017-03-30 D. Cazau , G. Revillon , O. Adam

A stream attention framework has been applied to the posterior probabilities of the deep neural network (DNN) to improve the far-field automatic speech recognition (ASR) performance in the multi-microphone configuration. The stream…

Sound · Computer Science 2017-12-01 Xiaofei Wang , Yonghong Yan , Hynek Hermansky

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The…

Machine Learning · Statistics 2016-02-12 Siddharth Sigtia , Emmanouil Benetos , Simon Dixon

Transformer based end-to-end modelling approaches with multiple stream inputs have been achieved great success in various automatic speech recognition (ASR) tasks. An important issue associated with such approaches is that the intermediate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-11 Jin Li , Rongfeng Su , Xurong Xie , Nan Yan , Lan Wang

Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-09 Yuke Lin , Ming Cheng , Ze Li , Beilong Tang , Ming Li

Deep learning has dramatically improved the performance of sounds recognition. However, learning acoustic models directly from the raw waveform is still challenging. Current waveform-based models generally use time-domain convolutional…

Sound · Computer Science 2018-03-29 Boqing Zhu , Changjian Wang , Feng Liu , Jin Lei , Zengquan Lu , Yuxing Peng

Extraction of the predominant pitch from polyphonic audio is one of the fundamental tasks in the field of music information retrieval and computational musicology. To accomplish this task using machine learning, a large amount of labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-07 Kavya Ranjan Saxena , Vipul Arora

Sound Event Detection and Audio Classification tasks are traditionally addressed through time-frequency representations of audio signals such as spectrograms. However, the emergence of deep neural networks as efficient feature extractors…

Automatic speech recognition (ASR) of single channel far-field recordings with an unknown number of speakers is traditionally tackled by cascaded modules. Recent research shows that end-to-end (E2E) multi-speaker ASR models can achieve…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Ilya Sklyar , Anna Piunova , Xianrui Zheng , Yulan Liu

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

Pitch detection is a fundamental problem in speech processing as F0 is used in a large number of applications. Recent articles have proposed deep learning for robust pitch tracking. In this paper, we consider voicing detection as a…

Sound · Computer Science 2019-03-06 Thomas Drugman , Goeric Huybrechts , Viacheslav Klimkov , Alexis Moinet

In the domain of Music Information Retrieval (MIR), Automatic Music Transcription (AMT) emerges as a central challenge, aiming to convert audio signals into symbolic notations like musical notes or sheet music. This systematic review…

Sound · Computer Science 2024-06-24 Fatemeh Jamshidi , Gary Pike , Amit Das , Richard Chapman

Chord recognition systems depend on robust feature extraction pipelines. While these pipelines are traditionally hand-crafted, recent advances in end-to-end machine learning have begun to inspire researchers to explore data-driven methods…

Machine Learning · Computer Science 2016-12-16 Filip Korzeniowski , Gerhard Widmer

Extracting pitch information from music recordings is a challenging but important problem in music signal processing. Frame-wise transcription or multi-pitch estimation aims for detecting the simultaneous activity of pitches in polyphonic…

Sound · Computer Science 2022-02-21 Christof Weiß , Geoffroy Peeters

In recent years, the task of Automatic Music Transcription (AMT), whereby various attributes of music notes are estimated from audio, has received increasing attention. At the same time, the related task of Multi-Pitch Estimation (MPE)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-18 Frank Cwitkowitz , Toni Hirvonen , Anssi Klapuri

This paper exploits the zero-shot capabilities of pre-trained large language models (LLMs) for music genre classification. The proposed approach splits audio signals into 20 ms chunks and processes them through convolutional feature…

We propose a novel pitch estimation technique called DeepF0, which leverages the available annotated data to directly learns from the raw audio in a data-driven manner. F0 estimation is important in various speech processing and music…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Satwinder Singh , Ruili Wang , Yuanhang Qiu

For many music analysis problems, we need to know the presence of instruments for each time frame in a multi-instrument musical piece. However, such a frame-level instrument recognition task remains difficult, mainly due to the lack of…

Sound · Computer Science 2019-02-19 Yun-Ning Hung , Yi-An Chen , Yi-Hsuan Yang

The detection of perceived prominence in speech has attracted approaches ranging from the design of linguistic knowledge-based acoustic features to the automatic feature learning from suprasegmental attributes such as pitch and intensity…

Computation and Language · Computer Science 2021-10-28 Mithilesh Vaidya , Kamini Sabu , Preeti Rao

Recently, MLP structures have regained popularity, with MLP-Mixer standing out as a prominent example. In the field of computer vision, MLP-Mixer is noted for its ability to extract data information from both channel and token perspectives,…

Machine Learning · Computer Science 2024-03-05 Qingfeng Ji , Yuxin Wang , Letong Sun