English
Related papers

Related papers: How to Measure Gender Bias in Machine Translation:…

200 papers

Gender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt a…

Computation and Language · Computer Science 2022-03-21 Beatrice Savoldi , Marco Gaido , Luisa Bentivogli , Matteo Negri , Marco Turchi

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

Addressing gender bias and maintaining logical coherence in machine translation remains challenging, particularly when translating between natural gender languages, like English, and genderless languages, such as Persian, Indonesian, and…

Computation and Language · Computer Science 2025-06-03 Pardis Sadat Zahraei , Ali Emami

Gender inequality is embedded in our communication practices and perpetuated in translation technologies. This becomes particularly apparent when translating into grammatical gender languages, where machine translation (MT) often defaults…

Computation and Language · Computer Science 2023-10-10 Andrea Piergentili , Beatrice Savoldi , Dennis Fucci , Matteo Negri , Luisa Bentivogli

Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted…

Computation and Language · Computer Science 2021-05-31 Marco Gaido , Beatrice Savoldi , Luisa Bentivogli , Matteo Negri , Marco Turchi

As generic machine translation (MT) quality has improved, the need for targeted benchmarks that explore fine-grained aspects of quality has increased. In particular, gender accuracy in translation can have implications in terms of output…

Computation and Language · Computer Science 2022-11-03 Anna Currey , Maria Nădejde , Raghavendra Pappagari , Mia Mayer , Stanislas Lauly , Xing Niu , Benjamin Hsu , Georgiana Dinu

Gender-inclusive machine translation (MT) should preserve gender ambiguity in the source to avoid misgendering and representational harms. While gender ambiguity often occurs naturally in notional gender languages such as English,…

Computation and Language · Computer Science 2025-06-19 Hillary Dawkins , Isar Nejadgholi , Chi-kiu Lo

The quality of machine translation has increased remarkably over the past years, to the degree that it was found to be indistinguishable from professional human translation in a number of empirical investigations. We reassess Hassan et…

Computation and Language · Computer Science 2020-04-06 Samuel Läubli , Sheila Castilho , Graham Neubig , Rico Sennrich , Qinlan Shen , Antonio Toral

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Neural Machine Translation (NMT) has been shown to struggle with grammatical gender that is dependent on the gender of human referents, which can cause gender bias effects. Many existing approaches to this problem seek to control gender…

Computation and Language · Computer Science 2020-12-11 Danielle Saunders , Rosie Sallis , Bill Byrne

Multilingual Neural Machine Translation architectures mainly differ in the amount of sharing modules and parameters among languages. In this paper, and from an algorithmic perspective, we explore if the chosen architecture, when trained…

Computation and Language · Computer Science 2020-12-25 Marta R. Costa-jussà , Carlos Escolano , Christine Basta , Javier Ferrando , Roser Batlle , Ksenia Kharitonova

Multilingual representations embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. These embeddings have been widely used in various settings,…

Computation and Language · Computer Science 2020-05-05 Jieyu Zhao , Subhabrata Mukherjee , Saghar Hosseini , Kai-Wei Chang , Ahmed Hassan Awadallah

Gender bias is highly impacting natural language processing applications. Word embeddings have clearly been proven both to keep and amplify gender biases that are present in current data sources. Recently, contextualized word embeddings…

Computation and Language · Computer Science 2019-04-19 Christine Basta , Marta R. Costa-jussà , Noe Casas

We investigate in this paper how distributions of occupations with respect to gender is reflected in pre-trained language models. Such distributions are not always aligned to normative ideals, nor do they necessarily reflect a descriptive…

Computation and Language · Computer Science 2023-04-13 Samia Touileb , Lilja Øvrelid , Erik Velldal

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

Computation and Language · Computer Science 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and…

Computation and Language · Computer Science 2021-05-13 Shanya Sharma , Manan Dey , Koustuv Sinha

Contextualized word embeddings have been replacing standard embeddings as the representational knowledge source of choice in NLP systems. Since a variety of biases have previously been found in standard word embeddings, it is crucial to…

Computation and Language · Computer Science 2020-10-29 Marion Bartl , Malvina Nissim , Albert Gatt

In this work, we investigate the presence of occupational gender stereotypes in sentiment analysis models. Such a task has implications for reducing implicit biases in these models, which are being applied to an increasingly wide variety of…

Computation and Language · Computer Science 2019-07-16 Jayadev Bhaskaran , Isha Bhallamudi

Recent studies in the field of Machine Translation (MT) and Natural Language Processing (NLP) have shown that existing models amplify biases observed in the training data. The amplification of biases in language technology has mainly been…

Computation and Language · Computer Science 2021-02-02 Eva Vanmassenhove , Dimitar Shterionov , Matthew Gwilliam