English

Wind Noise Reduction with a Diffusion-based Stochastic Regeneration Model

Audio and Speech Processing 2024-01-10 v2 Machine Learning Sound

Abstract

In this paper we present a method for single-channel wind noise reduction using our previously proposed diffusion-based stochastic regeneration model combining predictive and generative modelling. We introduce a non-additive speech in noise model to account for the non-linear deformation of the membrane caused by the wind flow and possible clipping. We show that our stochastic regeneration model outperforms other neural-network-based wind noise reduction methods as well as purely predictive and generative models, on a dataset using simulated and real-recorded wind noise. We further show that the proposed method generalizes well by testing on an unseen dataset with real-recorded wind noise. Audio samples, data generation scripts and code for the proposed methods can be found online (https://uhh.de/inf-sp-storm-wind).

Keywords

Cite

@article{arxiv.2306.12867,
  title  = {Wind Noise Reduction with a Diffusion-based Stochastic Regeneration Model},
  author = {Jean-Marie Lemercier and Joachim Thiemann and Raphael Koning and Timo Gerkmann},
  journal= {arXiv preprint arXiv:2306.12867},
  year   = {2024}
}

Comments

Accepted to VDE 15th ITG conference on Speech Communication

R2 v1 2026-06-28T11:11:53.371Z