English
Related papers

Related papers: On Evaluating and Mitigating Gender Biases in Mult…

200 papers

This work sets the ground for studying how explicit grammatical gender assignment in job titles can affect the results of automatic job ranking systems. We propose the usage of metrics for ranking comparison controlling for gender to…

Computation and Language · Computer Science 2025-09-18 Laura García-Sardiña , Hermenegildo Fabregat , Daniel Deniz , Rabih Zbib

Most works on gender bias focus on intrinsic bias -- removing traces of information about a protected group from the model's internal representation. However, these works are often disconnected from the impact of such debiasing on…

Computation and Language · Computer Science 2024-06-04 Bar Iluz , Yanai Elazar , Asaf Yehudai , Gabriel Stanovsky

Multilingual representations embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. These embeddings have been widely used in various settings,…

Computation and Language · Computer Science 2020-05-05 Jieyu Zhao , Subhabrata Mukherjee , Saghar Hosseini , Kai-Wei Chang , Ahmed Hassan Awadallah

Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in…

Computation and Language · Computer Science 2020-05-05 Emily Dinan , Angela Fan , Ledell Wu , Jason Weston , Douwe Kiela , Adina Williams

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

Language models (LMs) have become pivotal in the realm of technological advancements. While their capabilities are vast and transformative, they often include societal biases encoded in the human-produced datasets used for their training.…

Computation and Language · Computer Science 2024-01-30 Iñigo Parra

Language model debiasing has emerged as an important field of study in the NLP community. Numerous debiasing techniques were proposed, but bias ablation remains an unaddressed issue. We demonstrate a novel framework for inspecting bias in…

Computation and Language · Computer Science 2022-07-07 Przemyslaw Joniak , Akiko Aizawa

Language can be used as a means of reproducing and enforcing harmful stereotypes and biases and has been analysed as such in numerous research. In this paper, we present a survey of 304 papers on gender bias in natural language processing.…

Computation and Language · Computer Science 2021-12-30 Karolina Stanczak , Isabelle Augenstein

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov

As natural language processing systems become more widespread, it is necessary to address fairness issues in their implementation and deployment to ensure that their negative impacts on society are understood and minimized. However, there…

Computation and Language · Computer Science 2022-04-08 António Câmara , Nina Taneja , Tamjeed Azad , Emily Allaway , Richard Zemel

We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety of neural NLP tasks. Our empirical evaluation with…

Computation and Language · Computer Science 2019-06-03 Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , Anupam Datta

Although large pre-trained language models have achieved great success in many NLP tasks, it has been shown that they reflect human biases from their pre-training corpora. This bias may lead to undesirable outcomes when these models are…

Computation and Language · Computer Science 2022-11-29 Aristides Milios , Parishad BehnamGhader

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

Computation and Language · Computer Science 2023-06-28 Sophie Jentzsch , Cigdem Turan

Many studies have shown various biases targeting different demographic groups in language models, amplifying discrimination and harming fairness. Recent parameter modification debiasing approaches significantly degrade core capabilities…

Computation and Language · Computer Science 2025-10-01 Dianqing Liu , Yi Liu , Guoqing Jin , Zhendong Mao

Pre-trained large language models (LLMs) have been reliably integrated with visual input for multimodal tasks. The widespread adoption of instruction-tuned image-to-text vision-language assistants (VLAs) like LLaVA and InternVL necessitates…

Computers and Society · Computer Science 2025-03-14 Leander Girrbach , Stephan Alaniz , Yiran Huang , Trevor Darrell , Zeynep Akata

Pretrained language models inherently exhibit various social biases, prompting a crucial examination of their social impact across various linguistic contexts due to their widespread usage. Previous studies have provided numerous methods…

Computation and Language · Computer Science 2024-06-26 Jayanta Sadhu , Ayan Antik Khan , Abhik Bhattacharjee , Rifat Shahriyar

BERT and other large-scale language models (LMs) contain gender and racial bias. They also exhibit other dimensions of social bias, most of which have not been studied in depth, and some of which vary depending on the language. In this…

Computation and Language · Computer Science 2021-09-15 Jaimeen Ahn , Alice Oh

In this paper, we advance the current state-of-the-art method for debiasing monolingual word embeddings so as to generalize well in a multilingual setting. We consider different methods to quantify bias and different debiasing approaches…

Computation and Language · Computer Science 2021-07-23 Srijan Bansal , Vishal Garimella , Ayush Suhane , Animesh Mukherjee

In this study, we investigate extrinsic gender bias in Bangla pretrained language models, a largely underexplored area in low-resource languages. To assess this bias, we construct four manually annotated, task-specific benchmark datasets…

Computation and Language · Computer Science 2026-05-19 Sajib Kumar Saha Joy , Arman Hassan Mahy , Meherin Sultana , Azizah Mamun Abha , MD Piyal Ahmmed , Yue Dong , G M Shahariar