English

Gender Bias in Large Language Models across Multiple Languages

Computation and Language 2024-03-04 v1

Abstract

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing (NLP) has gained considerable focus, particularly in the context of English. Nonetheless, the investigation of gender bias in languages other than English is still relatively under-explored and insufficiently analyzed. In this work, We examine gender bias in LLMs-generated outputs for different languages. We use three measurements: 1) gender bias in selecting descriptive words given the gender-related context. 2) gender bias in selecting gender-related pronouns (she/he) given the descriptive words. 3) gender bias in the topics of LLM-generated dialogues. We investigate the outputs of the GPT series of LLMs in various languages using our three measurement methods. Our findings revealed significant gender biases across all the languages we examined.

Keywords

Cite

@article{arxiv.2403.00277,
  title  = {Gender Bias in Large Language Models across Multiple Languages},
  author = {Jinman Zhao and Yitian Ding and Chen Jia and Yining Wang and Zifan Qian},
  journal= {arXiv preprint arXiv:2403.00277},
  year   = {2024}
}

Comments

20 pages, 27 tables, 7 figures, submitted to ACL2024

R2 v1 2026-06-28T15:05:31.484Z