English

Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers

Computation and Language 2024-03-26 v2 Artificial Intelligence

Abstract

Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.

Keywords

Cite

@article{arxiv.2402.17914,
  title  = {Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers},
  author = {Roy Xie and Orevaoghene Ahia and Yulia Tsvetkov and Antonios Anastasopoulos},
  journal= {arXiv preprint arXiv:2402.17914},
  year   = {2024}
}

Comments

Code is available at https://github.com/ruoyuxie/interpretable_dialect_classifier

R2 v1 2026-06-28T15:02:36.824Z