English

Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement

Audio and Speech Processing 2026-05-08 v2

Abstract

While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is typically limited by physical constraints. To overcome this limitation, we propose Spatial-Magnifier, a neural network designed to generate virtual microphone (VM) signals from a limited set of real microphone (RM) measurements. Moreover, we introduce the Spatial Audio Representation Learning (SARL) framework, which leverages estimated VM signals and features to condition a downstream speech enhancement system. Experimental results demonstrate that the proposed framework outperforms existing spatial upsampling baselines across various speech extraction systems, including end-to-end multichannel speech enhancement and neural beamforming. The proposed method nearly recovers the oracle performance achieved when all microphones are available.

Keywords

Cite

@article{arxiv.2605.04749,
  title  = {Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement},
  author = {Dongheon Lee and Ashutosh Pandey and Sanjeel Parekh and Daniel Wong and Jacob Donley and Buye Xu and Juan Azcarreta},
  journal= {arXiv preprint arXiv:2605.04749},
  year   = {2026}
}

Comments

Submitted to InterSpeech 2026

R2 v1 2026-07-01T12:52:32.987Z