English

When Distributions Shifts: Causal Generalization for Low-Resource Languages

Computation and Language 2026-02-23 v2

Abstract

Machine learning models often fail under distribution shifts, a problem exacerbated in low-resource settings where limited data restricts robust generalization. Domain generalization(DG) methods address this challenge by learning representations that remain invariant across domains, frequently leveraging causal principles. In this work, we study two causal DG approaches for low-resource natural language processing. First, we apply causal data augmentation using GPT-4o-mini to generate counterfactual paraphrases for sentiment classification on the NaijaSenti Twitter corpus in Yoruba and Igbo. Second, we investigate invariant causal representation learning with the Debiasing in Aspect Review (DINER) framework for aspect-based sentiment analysis. We extend DINER to a multilingual setting by introducing Afri-SemEval, a dataset of 17 languages translated from SemEval-2014 Task. Experiments show improved robustness to unseen domains, with consistent gains from counterfactual augmentation and enhanced out-of-distribution performance from causal representation learning across multiple languages.

Keywords

Cite

@article{arxiv.2510.27512,
  title  = {When Distributions Shifts: Causal Generalization for Low-Resource Languages},
  author = {Mahi Aliyu Aminu and Chisom Chibuike and Fatimo Adebanjo and Omokolade Awosanya and Samuel Oyeneye},
  journal= {arXiv preprint arXiv:2510.27512},
  year   = {2026}
}
R2 v1 2026-07-01T07:15:41.813Z