English

Few-Shot Accent Synthesis for ASR with LLM-Guided Phoneme Editing

Sound 2026-05-01 v1

Abstract

Accented automatic speech recognition (ASR) often degrades due to the limited availability of accented training data. Prior work has explored accent modeling in low-resource settings, but existing approaches typically require minutes to hours of labeled speech, which may still be impractical for truly scarce accent scenarios. We propose a pipeline that adapts a text-to-speech (TTS) decoder to a target-accent speaker using fewer than ten reference utterances and employs large language model (LLM)-based phoneme editing to generate accent-conditioned pronunciations. The resulting synthetic speech is used to fine-tune a self-supervised ASR model. Experiments demonstrate consistent word error rate (WER) reductions on real accented speech, including cross-speaker evaluation and ultra-low data regimes. A matched-rate random phoneme baseline shows that phoneme-space perturbation itself is a strong form of augmentation, while LLM-guided edits provide additional gains through accent-conditioned structure.

Keywords

Cite

@article{arxiv.2604.27273,
  title  = {Few-Shot Accent Synthesis for ASR with LLM-Guided Phoneme Editing},
  author = {Yurii Halychanskyi and Nimet Beyza Bozdag and Mark Hasegawa-Johnson and Dilek Hakkani-Tür and Volodymyr Kindratenko},
  journal= {arXiv preprint arXiv:2604.27273},
  year   = {2026}
}

Comments

Submitted to Interspeech 2026