English
Related papers

Related papers: Gender-preserving Debiasing for Pre-trained Word E…

200 papers

As natural language processing methods are increasingly deployed in real-world scenarios such as healthcare, legal systems, and social science, it becomes necessary to recognize the role they potentially play in shaping social biases and…

Computation and Language · Computer Science 2020-07-17 Paul Pu Liang , Irene Mengze Li , Emily Zheng , Yao Chong Lim , Ruslan Salakhutdinov , Louis-Philippe Morency

Pre-trained language models encode undesirable social biases, which are further exacerbated in downstream use. To this end, we propose MABEL (a Method for Attenuating Gender Bias using Entailment Labels), an intermediate pre-training…

Computation and Language · Computer Science 2022-10-28 Jacqueline He , Mengzhou Xia , Christiane Fellbaum , Danqi Chen

Image captioning models are known to perpetuate and amplify harmful societal bias in the training set. In this work, we aim to mitigate such gender bias in image captioning models. While prior work has addressed this problem by forcing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yusuke Hirota , Yuta Nakashima , Noa Garcia

Language has a profound impact on our thoughts, perceptions, and conceptions of gender roles. Gender-inclusive language is, therefore, a key tool to promote social inclusion and contribute to achieving gender equality. Consequently,…

Computation and Language · Computer Science 2023-02-24 Jad Doughman , Wael Khreich

Mitigation of biases, such as language models' reliance on gender stereotypes, is a crucial endeavor required for the creation of reliable and useful language technology. The crucial aspect of debiasing is to ensure that the models preserve…

Computation and Language · Computer Science 2025-02-03 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Word embedding, which converts words into numerical values, is an important natural language processing technique and widely used. One of the serious problems of word embedding is that the bias will be learned and affect the model if the…

Human-Computer Interaction · Computer Science 2025-06-04 Arisa Sugino , Takayuki Itoh

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Speech emotion recognition (SER) systems often exhibit gender bias. However, the effectiveness and robustness of existing debiasing methods in such multi-label scenarios remain underexplored. To address this gap, we present EMO-Debias, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-06 Yi-Cheng Lin , Huang-Cheng Chou , Yu-Hsuan Li Liang , Hung-yi Lee

Non-contextual word embedding models have been shown to inherit human-like stereotypical biases of gender, race and religion from the training corpora. To counter this issue, a large body of research has emerged which aims to mitigate these…

Computation and Language · Computer Science 2020-10-27 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar

This paper presents an algorithm for enumerating biases in word embeddings. The algorithm exposes a large number of offensive associations related to sensitive features such as race and gender on publicly available embeddings, including a…

Computation and Language · Computer Science 2019-06-21 Nathaniel Swinger , Maria De-Arteaga , Neil Thomas Heffernan , Mark DM Leiserson , Adam Tauman Kalai

It has been shown that word embeddings can exhibit gender bias, and various methods have been proposed to quantify this. However, the extent to which the methods are capturing social stereotypes inherited from the data has been debated.…

Computation and Language · Computer Science 2020-10-29 Haiyang Zhang , Alison Sneyd , Mark Stevenson

Recent research in Natural Language Processing has revealed that word embeddings can encode social biases present in the training data which can affect minorities in real world applications. This paper explores the gender bias implicit in…

Computation and Language · Computer Science 2020-11-05 Rodrigo Alejandro Chávez Mulsa , Gerasimos Spanakis

When trained on large, unfiltered crawls from the internet, language models pick up and reproduce all kinds of undesirable biases that can be found in the data: they often generate racist, sexist, violent or otherwise toxic language. As…

Computation and Language · Computer Science 2021-09-10 Timo Schick , Sahana Udupa , Hinrich Schütze

Word embeddings are the standard model for semantic and syntactic representations of words. Unfortunately, these models have been shown to exhibit undesirable word associations resulting from gender, racial, and religious biases. Existing…

Computation and Language · Computer Science 2020-06-04 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar , Tanmoy Chakraborty

Existing word embedding debiasing methods require social-group-specific word pairs (e.g., "man"-"woman") for each social attribute (e.g., gender), which cannot be used to mitigate bias for other social groups, making these methods…

Computation and Language · Computer Science 2022-10-13 Ali Omrani , Brendan Kennedy , Mohammad Atari , Morteza Dehghani

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and…

Computation and Language · Computer Science 2021-05-13 Shanya Sharma , Manan Dey , Koustuv Sinha

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

Machine learning models have been shown to inherit biases from their training datasets. This can be particularly problematic for vision-language foundation models trained on uncurated datasets scraped from the internet. The biases can be…

Machine Learning · Computer Science 2023-05-16 Ching-Yao Chuang , Varun Jampani , Yuanzhen Li , Antonio Torralba , Stefanie Jegelka

We investigate whether it is feasible to remove gendered information from resumes to mitigate potential bias in algorithmic resume screening. Using a corpus of 709k resumes from IT firms, we first train a series of models to classify the…

Computation and Language · Computer Science 2022-07-14 Prasanna Parasurama , João Sedoc

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

Computation and Language · Computer Science 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar