English

Overlap-aware diarization: resegmentation using neural end-to-end overlapped speech detection

Audio and Speech Processing 2019-10-28 v1 Sound

Abstract

We address the problem of effectively handling overlapping speech in a diarization system. First, we detail a neural Long Short-Term Memory-based architecture for overlap detection. Secondly, detected overlap regions are exploited in conjunction with a frame-level speaker posterior matrix to make two-speaker assignments for overlapped frames in the resegmentation step. The overlap detection module achieves state-of-the-art performance on the AMI, DIHARD, and ETAPE corpora. We apply overlap-aware resegmentation on AMI, resulting in a 20% relative DER reduction over the baseline system. While this approach is by no means an end-all solution to overlap-aware diarization, it reveals promising directions for handling overlap.

Keywords

Cite

@article{arxiv.1910.11646,
  title  = {Overlap-aware diarization: resegmentation using neural end-to-end overlapped speech detection},
  author = {Latané Bullock and Hervé Bredin and Leibny Paola Garcia-Perera},
  journal= {arXiv preprint arXiv:1910.11646},
  year   = {2019}
}

Comments

Submitted to ICASSP 2020

R2 v1 2026-06-23T11:54:48.477Z