English
Related papers

Related papers: Dissecting Performance Degradation in Audio Source…

200 papers

Listening to the audio of TV broadcast signals can be challenging for hearing-impaired as well as normal-hearing listeners, especially when background sounds are prominent or too loud compared to the speech signal. This can result in a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-04 Nils L. Westhausen , Rainer Huber , Hannah Baumgartner , Ragini Sinha , Jan Rennies , Bernd T. Meyer

Recent work has shown that recurrent neural networks can be trained to separate individual speakers in a sound mixture with high fidelity. Here we explore convolutional neural network models as an alternative and show that they achieve…

Sound · Computer Science 2018-05-29 Shariq Mobin , Brian Cheung , Bruno Olshausen

The performance of speech processing models trained on clean speech drops significantly in noisy conditions. Training with noisy datasets alleviates the problem, but procuring such datasets is not always feasible. Noisy speech simulation…

Sound · Computer Science 2023-05-23 Leander Melroy Maben , Zixun Guo , Chen Chen , Utkarsh Chudiwal , Chng Eng Siong

Audio fingerprinting is a well-established solution for song identification from short recording excerpts. Popular methods rely on the extraction of sparse representations, generally spectral peaks, and have proven to be accurate, fast, and…

Sound · Computer Science 2023-10-31 Kamil Akesbi , Dorian Desblancs , Benjamin Martin

In live and studio recordings unexpected sound events often lead to interferences in the signal. For non-stationary interferences, sound source separation techniques can be used to reduce the interference level in the recording. In this…

Sound · Computer Science 2017-11-01 Delia Fano Yela , Sebastian Ewert , Derry FitzGerald , Mark Sandler

In this paper, we present an efficient neural network for end-to-end general purpose audio source separation. Specifically, the backbone structure of this convolutional network is the SUccessive DOwnsampling and Resampling of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-14 Efthymios Tzinis , Zhepei Wang , Paris Smaragdis

A deep neural network solution for time-scale modification (TSM) focused on large stretching factors is proposed, targeting environmental sounds. Traditional TSM artifacts such as transient smearing, loss of presence, and phasiness are…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-01 Leonardo Fierro , Alec Wright , Vesa Välimäki , Matti Hämäläinen

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

In this paper, we propose NU-GAN, a new method for resampling audio from lower to higher sampling rates (upsampling). Audio upsampling is an important problem since productionizing generative speech technology requires operating at high…

Sound · Computer Science 2020-10-23 Rithesh Kumar , Kundan Kumar , Vicki Anand , Yoshua Bengio , Aaron Courville

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for…

Machine Learning · Computer Science 2018-07-12 Veronica Morfi , Dan Stowell

In Fourier-based medical imaging, sampling below the Nyquist rate results in an underdetermined system, in which linear reconstructions will exhibit artifacts. Another consequence of under-sampling is lower signal to noise ratio (SNR) due…

Computer Vision and Pattern Recognition · Computer Science 2016-10-04 Patrick Virtue , Michael Lustig

The term "differentiable digital signal processing" describes a family of techniques in which loss function gradients are backpropagated through digital signal processors, facilitating their integration into neural networks. This article…

Sound · Computer Science 2023-08-30 Ben Hayes , Jordie Shier , György Fazekas , Andrew McPherson , Charalampos Saitis

This paper deals with the problem of audio source separation. To handle the complex and ill-posed nature of the problems of audio source separation, the current state-of-the-art approaches employ deep neural networks to obtain instrumental…

Sound · Computer Science 2017-06-30 Naoya Takahashi , Yuki Mitsufuji

The performance of voice-based Parkinson's disease (PD) detection systems degrades when there is an acoustic mismatch between training and operating conditions caused mainly by degradation in test signals. In this paper, we address this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-03 Amir Hossein Poorjam , Mathew Shaji Kavalekalam , Liming Shi , Yordan P. Raykov , Jesper Rindom Jensen , Max A. Little , Mads Græsbøll Christensen

This paper addresses the challenge of speaker separation, which remains an active research topic despite the promising results achieved in recent years. These results, however, often degrade in real recording conditions due to the presence…

Sound · Computer Science 2024-11-14 Rawad Melhem , Assef Jafar , Oumayma Al Dakkak

This paper introduces a reconstruction approach for the input signal of an oversampled filter bank (OFB) when the sub-bands generated at its output are quantized and transmitted over a noisy channel. This approach exploits the redundancy…

Networking and Internet Architecture · Computer Science 2011-08-30 Manel Abid , Michel Kieffer , Beatrice Pesquet-Popescu

Pre-trained automatic speech recognition (ASR) models have demonstrated strong performance on a variety of tasks. However, their performance can degrade substantially when the input audio comes from different recording channels. While…

Sound · Computer Science 2025-08-25 Kuan-Tang Huang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

In this paper, we propose a two-step training procedure for source separation via a deep neural network. In the first step we learn a transform (and it's inverse) to a latent space where masking-based separation performance using oracles is…

Machine Learning · Computer Science 2021-05-12 Efthymios Tzinis , Shrikant Venkataramani , Zhepei Wang , Cem Subakan , Paris Smaragdis

Deep learning approaches have recently achieved impressive performance on both audio source separation and sound classification. Most audio source separation approaches focus only on separating sources belonging to a restricted domain of…

Sound · Computer Science 2021-05-14 Efthymios Tzinis , Scott Wisdom , John R. Hershey , Aren Jansen , Daniel P. W. Ellis

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Jouni Paulus , Matteo Torcoli