SCDiar: a streaming diarization system based on speaker change detection and speech recognition
Abstract
In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a system that operates on speech segments, split at the token level by a speaker change detection (SCD) module. Building on these segments, we introduce several enhancements to efficiently select the best available segment for each speaker. These improvements lead to significant gains across various benchmarks. Notably, on real-world meeting data involving more than ten participants, SCDiar outperforms previous systems by up to 53.6\% in accuracy, substantially narrowing the performance gap between online and offline systems.
Cite
@article{arxiv.2501.16641,
title = {SCDiar: a streaming diarization system based on speaker change detection and speech recognition},
author = {Naijun Zheng and Xucheng Wan and Kai Liu and Zhou Huan},
journal= {arXiv preprint arXiv:2501.16641},
year = {2025}
}
Comments
Accepted at ICASSP 2025