English

Measuring Sentiment Bias in Machine Translation

Computation and Language 2023-06-13 v1

Abstract

Biases induced to text by generative models have become an increasingly large topic in recent years. In this paper we explore how machine translation might introduce a bias in sentiments as classified by sentiment analysis models. For this, we compare three open access machine translation models for five different languages on two parallel corpora to test if the translation process causes a shift in sentiment classes recognized in the texts. Though our statistic test indicate shifts in the label probability distributions, we find none that appears consistent enough to assume a bias induced by the translation process.

Keywords

Cite

@article{arxiv.2306.07152,
  title  = {Measuring Sentiment Bias in Machine Translation},
  author = {Kai Hartung and Aaricia Herygers and Shubham Kurlekar and Khabbab Zakaria and Taylan Volkan and Sören Gröttrup and Munir Georges},
  journal= {arXiv preprint arXiv:2306.07152},
  year   = {2023}
}

Comments

12 pages, 5 figures, accepted at TSD 2023

R2 v1 2026-06-28T11:03:00.333Z