Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
Abstract
While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is typically limited by physical constraints. To overcome this limitation, we propose Spatial-Magnifier, a neural network designed to generate virtual microphone (VM) signals from a limited set of real microphone (RM) measurements. Moreover, we introduce the Spatial Audio Representation Learning (SARL) framework, which leverages estimated VM signals and features to condition a downstream speech enhancement system. Experimental results demonstrate that the proposed framework outperforms existing spatial upsampling baselines across various speech extraction systems, including end-to-end multichannel speech enhancement and neural beamforming. The proposed method nearly recovers the oracle performance achieved when all microphones are available.
Cite
@article{arxiv.2605.04749,
title = {Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement},
author = {Dongheon Lee and Ashutosh Pandey and Sanjeel Parekh and Daniel Wong and Jacob Donley and Buye Xu and Juan Azcarreta},
journal= {arXiv preprint arXiv:2605.04749},
year = {2026}
}
Comments
Submitted to InterSpeech 2026