English

SCDiar: a streaming diarization system based on speaker change detection and speech recognition

Audio and Speech Processing 2025-01-29 v1 Human-Computer Interaction Sound

Abstract

In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a system that operates on speech segments, split at the token level by a speaker change detection (SCD) module. Building on these segments, we introduce several enhancements to efficiently select the best available segment for each speaker. These improvements lead to significant gains across various benchmarks. Notably, on real-world meeting data involving more than ten participants, SCDiar outperforms previous systems by up to 53.6\% in accuracy, substantially narrowing the performance gap between online and offline systems.

Keywords

Cite

@article{arxiv.2501.16641,
  title  = {SCDiar: a streaming diarization system based on speaker change detection and speech recognition},
  author = {Naijun Zheng and Xucheng Wan and Kai Liu and Zhou Huan},
  journal= {arXiv preprint arXiv:2501.16641},
  year   = {2025}
}

Comments

Accepted at ICASSP 2025

R2 v1 2026-06-28T21:21:09.608Z