Domain Adaptation of the Pyannote Diarization Pipeline for Conversational Indonesian Audio
Abstract
This study presents a domain adaptation approach for speaker diarization targeting conversational Indonesian audio. We address the challenge of adapting an English-centric diarization pipeline to a low-resource language by employing synthetic data generation using neural Text-to-Speech technology. Experiments were conducted with varying training configurations, a small dataset (171 samples) and a large dataset containing 25 hours of synthetic speech. Results demonstrate that the baseline \texttt{pyannote/segmentation-3.0} model, trained on the AMI Corpus, achieves a Diarization Error Rate (DER) of 53.47\% when applied zero-shot to Indonesian. Domain adaptation significantly improves performance, with the small dataset models reducing DER to 34.31\% (1 epoch) and 34.81\% (2 epochs). The model trained on the 25-hour dataset achieves the best performance with a DER of 29.24\%, representing a 13.68\% absolute improvement over the baseline while maintaining 99.06\% Recall and 87.14\% F1-Score.
Cite
@article{arxiv.2601.03684,
title = {Domain Adaptation of the Pyannote Diarization Pipeline for Conversational Indonesian Audio},
author = {Muhammad Daffa'i Rafi Prasetyo and Ramadhan Andika Putra and Zaidan Naufal Ilmi and Kurniawati Azizah},
journal= {arXiv preprint arXiv:2601.03684},
year = {2026}
}
Comments
Experiments conducted using synthetic Indonesian conversational speech for domain adaptation