English

CUPE: Contextless Universal Phoneme Encoder for Language-Agnostic Speech Processing

Computation and Language 2025-08-22 v1 Machine Learning Audio and Speech Processing

Abstract

Universal phoneme recognition typically requires analyzing long speech segments and language-specific patterns. Many speech processing tasks require pure phoneme representations free from contextual influence, which motivated our development of CUPE - a lightweight model that captures key phoneme features in just 120 milliseconds, about one phoneme's length. CUPE processes short, fixed-width windows independently and, despite fewer parameters than current approaches, achieves competitive cross-lingual performance by learning fundamental acoustic patterns common to all languages. Our extensive evaluation through supervised and self-supervised training on diverse languages, including zero-shot tests on the UCLA Phonetic Corpus, demonstrates strong cross-lingual generalization and reveals that effective universal speech processing is possible through modeling basic acoustic patterns within phoneme-length windows.

Keywords

Cite

@article{arxiv.2508.15316,
  title  = {CUPE: Contextless Universal Phoneme Encoder for Language-Agnostic Speech Processing},
  author = {Abdul Rehman and Jian-Jun Zhang and Xiaosong Yang},
  journal= {arXiv preprint arXiv:2508.15316},
  year   = {2025}
}

Comments

Accepted in: 8th International Conference on Natural Language and Speech Processing (ICNLSP 2025)

R2 v1 2026-07-01T04:59:35.876Z