English
Related papers

Related papers: How to Measure Gender Bias in Machine Translation:…

200 papers

Recent works have found evidence of gender bias in models of machine translation and coreference resolution using mostly synthetic diagnostic datasets. While these quantify bias in a controlled experiment, they often do so on a small scale…

Computation and Language · Computer Science 2021-09-13 Shahar Levy , Koren Lazar , Gabriel Stanovsky

This work sets the ground for studying how explicit grammatical gender assignment in job titles can affect the results of automatic job ranking systems. We propose the usage of metrics for ranking comparison controlling for gender to…

Computation and Language · Computer Science 2025-09-18 Laura García-Sardiña , Hermenegildo Fabregat , Daniel Deniz , Rabih Zbib

When translating "The secretary asked for details." to a language with grammatical gender, it might be necessary to determine the gender of the subject "secretary". If the sentence does not contain the necessary information, it is not…

Computation and Language · Computer Science 2020-10-20 Artūrs Stafanovičs , Toms Bergmanis , Mārcis Pinnis

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

Neural Machine Translation (NMT) models, though state-of-the-art for translation, often reflect social biases, particularly gender bias. Existing evaluation benchmarks primarily focus on English as the source language of translation. For…

Computation and Language · Computer Science 2023-12-08 Pushpdeep Singh

Machine Translation (MT) systems frequently encounter gender-ambiguous occupational terms, where they must assign gender without explicit contextual cues. While individual translations in such cases may not be inherently biased, systematic…

Computation and Language · Computer Science 2025-09-23 Orfeas Menis Mastromichalakis , Giorgos Filandrianos , Maria Symeonaki , Giorgos Stamou

Quality estimation (QE)-the automatic assessment of translation quality-has recently become crucial across several stages of the translation pipeline, from data curation to training and decoding. While QE metrics have been optimized to…

Computation and Language · Computer Science 2025-06-04 Emmanouil Zaranis , Giuseppe Attanasio , Sweta Agrawal , André F. T. Martins

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

This chapter examines the role of Machine Translation in perpetuating gender bias, highlighting the challenges posed by cross-linguistic settings and statistical dependencies. A comprehensive overview of relevant existing work related to…

Computation and Language · Computer Science 2024-01-19 Eva Vanmassenhove

With language models being deployed increasingly in the real world, it is essential to address the issue of the fairness of their outputs. The word embedding representations of these language models often implicitly draw unwanted…

Computation and Language · Computer Science 2021-06-17 Gauri Gupta , Krithika Ramesh , Sanjay Singh

In this multicultural age, language translation is one of the most performed tasks, and it is becoming increasingly AI-moderated and automated. As a novel AI system, ChatGPT claims to be proficient in such translation tasks and in this…

Computers and Society · Computer Science 2024-08-06 Sourojit Ghosh , Aylin Caliskan

Neural Machine Translation (NMT) models are state-of-the-art for machine translation. However, these models are known to have various social biases, especially gender bias. Most of the work on evaluating gender bias in NMT has focused…

Computation and Language · Computer Science 2024-11-05 Pushpdeep Singh

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

Machine Translation (MT) continues to improve in quality and adoption, yet the inadvertent perpetuation of gender bias remains a significant concern. Despite numerous studies into gender bias in translations from gender-neutral languages…

Computation and Language · Computer Science 2023-12-14 Spencer Rarrick , Ranjita Naik , Sundar Poudel , Vishal Chowdhary

Implicit gender bias in Large Language Models (LLMs) is a well-documented problem, and implications of gender introduced into automatic translations can perpetuate real-world biases. However, some LLMs use heuristics or post-processing to…

Computation and Language · Computer Science 2024-04-03 Peter J Barclay , Ashkan Sami

Neural Machine Translation models tend to perpetuate gender bias present in their training data distribution. Context-aware models have been previously suggested as a means to mitigate this type of bias. In this work, we examine this claim…

Computation and Language · Computer Science 2024-06-19 Harritxu Gete , Thierry Etchegoyhen

Machine Translation (MT) continues to make significant strides in quality and is increasingly adopted on a larger scale. Consequently, analyses have been redirected to more nuanced aspects, intricate phenomena, as well as potential risks…

Computation and Language · Computer Science 2024-03-28 Silvia Alma Piazzolla , Beatrice Savoldi , Luisa Bentivogli

We study the effect of tokenization on gender bias in machine translation, an aspect that has been largely overlooked in previous works. Specifically, we focus on the interactions between the frequency of gendered profession names in…

Computation and Language · Computer Science 2023-10-03 Bar Iluz , Tomasz Limisiewicz , Gabriel Stanovsky , David Mareček

Large Language Models (LLMs) are increasingly leveraged for translation tasks but often fall short when translating inclusive language -- such as texts containing the singular 'they' pronoun or otherwise reflecting fair linguistic…

Computation and Language · Computer Science 2025-05-06 Fanny Jourdan , Yannick Chevalier , Cécile Favre

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian