English

Spatially-Augmented Sequence-to-Sequence Neural Diarization for Meetings

Audio and Speech Processing 2026-03-10 v2

Abstract

This paper proposes a Spatially-Augmented Sequence-to-Sequence Neural Diarization (SA-S2SND) framework, which integrates direction-of-arrival (DOA) cues estimated by SRP-DNN into the S2SND backbone. A two-stage training strategy is adopted: the model is first trained with single-channel audio and DOA features, and then further optimized with multi-channel inputs under DOA guidance. In addition, a simulated DOA generation scheme is introduced to alleviate dependence on matched multi-channel corpora. On the AliMeeting dataset, SA-S2SND consistently outperform the S2SND baseline, achieving a 7.4% relative DER reduction in the offline mode and over 19% improvement when combined with channel attention. These results demonstrate that spatial cues are highly complementary to cross-channel modeling, yielding good performance in both online and offline settings.

Keywords

Cite

@article{arxiv.2510.09505,
  title  = {Spatially-Augmented Sequence-to-Sequence Neural Diarization for Meetings},
  author = {Li Li and Ming Cheng and Juan Liu and Ming Li},
  journal= {arXiv preprint arXiv:2510.09505},
  year   = {2026}
}

Comments

Submitted to Interspeech 2026

R2 v1 2026-07-01T06:29:40.274Z