Unsupervised Multi-channel Speech Dereverberation via Diffusion
Abstract
We consider the problem of multi-channel single-speaker blind dereverberation, where multi-channel mixtures are used to recover the clean anechoic speech. To solve this problem, we propose USD-DPS, {U}nsupervised {S}peech {D}ereverberation via {D}iffusion {P}osterior {S}ampling. USD-DPS uses an unconditional clean speech diffusion model as a strong prior to solve the problem by posterior sampling. At each diffusion sampling step, we estimate all microphone channels' room impulse responses (RIRs), which are further used to enforce a multi-channel mixture consistency constraint for diffusion guidance. For multi-channel RIR estimation, we estimate reference-channel RIR by optimizing RIR parameters of a sub-band RIR signal model, with the Adam optimizer. We estimate non-reference channels' RIRs analytically using forward convolutive prediction (FCP). We found that this combination provides a good balance between sampling efficiency and RIR prior modeling, which shows superior performance among unsupervised dereverberation approaches. An audio demo page is provided in https://usddps.github.io/USDDPS_demo/.
Keywords
Cite
@article{arxiv.2508.02071,
title = {Unsupervised Multi-channel Speech Dereverberation via Diffusion},
author = {Yulun Wu and Zhongweiyang Xu and Jianchong Chen and Zhong-Qiu Wang and Romit Roy Choudhury},
journal= {arXiv preprint arXiv:2508.02071},
year = {2025}
}