Umm... With Transformers? Insights from Filled Pause Use across Four Slavic Parliaments
Abstract
Filled pauses (FPs) are a universal feature of spontaneous speech, yet most studies rely on small, single-language corpora, limiting the generalisability of their findings. We analyse ~4,000 hours of parliamentary speech across four related Slavic languages (Croatian, Czech, Polish, Serbian). FP occurrence is obtained via transformer-based automatic detection, while FP rate is modelled using Generalised Estimating Equations (GEE) with Mundlak correction to distinguish within- from between- speaker effects. We replicate a negative association of age and speech rate with FP rate, but find that gender effects are language-specific and directionally opposite to most prior literature. Novel analyses of sentiment, political orientation, and power status reveal a consistent positive association between sentiment and FP rate, alongside parliament-specific modulation by orientation and power status, with opposition speakers tending toward lower FP rates than governing coalition speakers.
Keywords
Cite
@article{arxiv.2607.05964,
title = {Umm... With Transformers? Insights from Filled Pause Use across Four Slavic Parliaments},
author = {Ivan Porupski and Branimir Dropuljić and Nikola Ljubešić},
journal= {arXiv preprint arXiv:2607.05964},
year = {2026}
}
Comments
6 pages, 1 figure. Accepted at InterSpeech 2026. Code published: https://doi.org/10.5281/zenodo.20766877