English

End-to-End Multi-Microphone Speaker Extraction Using Relative Transfer Functions

Sound 2025-02-11 v1 Artificial Intelligence

Abstract

This paper introduces a multi-microphone method for extracting a desired speaker from a mixture involving multiple speakers and directional noise in a reverberant environment. In this work, we propose leveraging the instantaneous relative transfer function (RTF), estimated from a reference utterance recorded in the same position as the desired source. The effectiveness of the RTF-based spatial cue is compared with direction of arrival (DOA)-based spatial cue and the conventional spectral embedding. Experimental results in challenging acoustic scenarios demonstrate that using spatial cues yields better performance than the spectral-based cue and that the instantaneous RTF outperforms the DOA-based spatial cue.

Keywords

Cite

@article{arxiv.2502.06285,
  title  = {End-to-End Multi-Microphone Speaker Extraction Using Relative Transfer Functions},
  author = {Aviad Eisenberg and Sharon Gannot and Shlomo E. Chazan},
  journal= {arXiv preprint arXiv:2502.06285},
  year   = {2025}
}
R2 v1 2026-06-28T21:38:18.370Z