English
Related papers

Related papers: Assessing Gender Bias in Machine Translation -- A …

200 papers

We introduce new large labeled datasets on bias in 3 languages and show in experiments that bias exists in all 10 datasets of 5 languages evaluated, including benchmark datasets on the English GLUE/SuperGLUE leaderboards. The 3 new…

Computation and Language · Computer Science 2024-09-24 Irene Pagliai , Goya van Boven , Tosin Adewumi , Lama Alkhaled , Namrata Gurung , Isabella Södergren , Elisa Barney

In recent years, generative artificial intelligence (GenAI) systems have assumed increasingly crucial roles in selection processes, personnel recruitment and analysis of candidates' profiles. However, the employment of large language models…

Artificial Intelligence · Computer Science 2026-03-13 Martina Ullasci , Marco Rondina , Riccardo Coppola , Antonio Vetrò

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

With the increasing attention non-binary people receive in Western societies, strategies of gender-fair language have started to move away from binary (only female/male) concepts of gender. Nevertheless, hardly any approaches to take these…

Computation and Language · Computer Science 2023-05-03 Sabrina Burtscher , Katta Spiel , Lukas Daniel Klausner , Manuel Lardelli , Dagmar Gromann

This chapter focuses on gender-related errors in machine translation (MT) in the context of low-resource languages. We begin by explaining what low-resource languages are, examining the inseparable social and computational factors that…

Computation and Language · Computer Science 2024-03-13 Sourojit Ghosh , Srishti Chatterjee

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Neural Machine Translation (NMT) models, though state-of-the-art for translation, often reflect social biases, particularly gender bias. Existing evaluation benchmarks primarily focus on English as the source language of translation. For…

Computation and Language · Computer Science 2023-12-08 Pushpdeep Singh

Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted…

Computation and Language · Computer Science 2021-05-31 Marco Gaido , Beatrice Savoldi , Luisa Bentivogli , Matteo Negri , Marco Turchi

Neural Machine Translation (NMT) models are state-of-the-art for machine translation. However, these models are known to have various social biases, especially gender bias. Most of the work on evaluating gender bias in NMT has focused…

Computation and Language · Computer Science 2024-11-05 Pushpdeep Singh

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and…

Computation and Language · Computer Science 2021-05-13 Shanya Sharma , Manan Dey , Koustuv Sinha

Gender bias is a significant issue in machine translation, leading to ongoing research efforts in developing bias mitigation techniques. However, most works focus on debiasing bilingual models without much consideration for multilingual…

Computation and Language · Computer Science 2023-11-13 Minwoo Lee , Hyukhun Koh , Kang-il Lee , Dongdong Zhang , Minsung Kim , Kyomin Jung

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural…

Computation and Language · Computer Science 2025-01-22 Damin Zhang , Yi Zhang , Geetanjali Bihani , Julia Rayz

This paper examines gender bias in AI-generated imagery of construction workers, highlighting discrepancies in the portrayal of male and female figures. Grounded in Griselda Pollock's theories on visual culture and gender, the analysis…

Computers and Society · Computer Science 2024-07-29 Amalia Foka

With the rise of human-machine communication, machines are increasingly designed with humanlike characteristics, such as gender, which can inadvertently trigger cognitive biases. Many conversational agents (CAs), such as voice assistants…

Human-Computer Interaction · Computer Science 2024-01-09 Weizi Liu

The rapid development of AI tools and implementation of LLMs within downstream tasks has been paralleled by a surge in research exploring how the outputs of such AI/LLM systems embed biases, a research topic which was already being…

Computers and Society · Computer Science 2025-08-18 Sourojit Ghosh , Kyra Wilson

Large language models (LLMs) are becoming increasingly ubiquitous in our daily lives, but numerous concerns about bias in LLMs exist. This study examines how gender-diverse populations perceive bias, accuracy, and trustworthiness in LLMs,…

Human-Computer Interaction · Computer Science 2025-07-09 Aimen Gaba , Emily Wall , Tejas Ramkumar Babu , Yuriy Brun , Kyle Hall , Cindy Xiong Bearfield

This study delves into the pervasive issue of gender issues in artificial intelligence (AI), specifically within automatic scoring systems for student-written responses. The primary objective is to investigate the presence of gender biases,…

Computers and Society · Computer Science 2025-01-29 Ehsan Latif , Xiaoming Zhai , Lei Liu