English
Related papers

Related papers: Debiasing Embeddings for Reduced Gender Bias in Te…

200 papers

It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Although many such texts contain stereotypes and biases that inherently exist in natural language for reasons…

Computation and Language · Computer Science 2022-01-24 Ewoenam Kwaku Tokpo , Toon Calders

Non-contextual word embedding models have been shown to inherit human-like stereotypical biases of gender, race and religion from the training corpora. To counter this issue, a large body of research has emerged which aims to mitigate these…

Computation and Language · Computer Science 2020-10-27 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar

Bias in word embeddings such as Word2Vec has been widely investigated, and many efforts made to remove such bias. We show how to use conceptors debiasing to post-process both traditional and contextualized word embeddings. Our conceptor…

Computation and Language · Computer Science 2019-06-17 Saket Karve , Lyle Ungar , João Sedoc

As natural language processing methods are increasingly deployed in real-world scenarios such as healthcare, legal systems, and social science, it becomes necessary to recognize the role they potentially play in shaping social biases and…

Computation and Language · Computer Science 2020-07-17 Paul Pu Liang , Irene Mengze Li , Emily Zheng , Yao Chong Lim , Ruslan Salakhutdinov , Louis-Philippe Morency

Distributional word vectors have recently been shown to encode many of the human biases, most notably gender and racial biases, and models for attenuating such biases have consequently been proposed. However, existing models and studies (1)…

Computation and Language · Computer Science 2020-01-06 Anne Lauscher , Goran Glavaš , Simone Paolo Ponzetto , Ivan Vulić

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

Machine Learning · Computer Science 2021-05-03 Maarten Buyl , Tijl De Bie

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

Computation and Language · Computer Science 2022-05-13 Neeraja Kirtane , Tanvi Anand

It has been shown that word embeddings derived from large corpora tend to incorporate biases present in their training data. Various methods for mitigating these biases have been proposed, but recent work has demonstrated that these methods…

Computation and Language · Computer Science 2023-06-27 Hailey Joren , David Alvarez-Melis

Societal biases are reflected in large pre-trained language models and their fine-tuned versions on downstream tasks. Common in-processing bias mitigation approaches, such as adversarial training and mutual information removal, introduce…

Machine Learning · Computer Science 2023-06-06 Lukas Hauzenberger , Shahed Masoudian , Deepak Kumar , Markus Schedl , Navid Rekabsaz

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data…

Computation and Language · Computer Science 2021-04-13 Xisen Jin , Francesco Barbieri , Brendan Kennedy , Aida Mostafazadeh Davani , Leonardo Neves , Xiang Ren

It has recently been shown that word embeddings encode social biases, with a harmful impact on downstream tasks. However, to this point there has been no similar work done in the field of graph embeddings. We present the first study on…

Computation and Language · Computer Science 2020-05-08 Joseph Fisher , Dave Palfrey , Christos Christodoulopoulos , Arpit Mittal

We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety of neural NLP tasks. Our empirical evaluation with…

Computation and Language · Computer Science 2019-06-03 Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , Anupam Datta

Statistical decision algorithms are increasingly deployed in domains where ground-truth labels are hard to obtain, such as hiring, university admissions, and content moderation. In these settings, models are typically trained on historical…

Machine Learning · Computer Science 2026-05-21 Calvin Isley , Johann D. Gaebler , Sharad Goel

Language Representation Models (LRMs) trained with real-world data may capture and exacerbate undesired bias and cause unfair treatment of people in various demographic groups. Several techniques have been investigated for applying…

Computation and Language · Computer Science 2023-11-14 Chloe Qinyu Zhu , Rickard Stureborg , Brandon Fain

Recent research has demonstrated that vector space models of semantics can reflect undesirable biases in human culture. Our investigation of crosslinguistic word embeddings reveals that topical gender bias interacts with, and is surpassed…

Computation and Language · Computer Science 2020-05-19 Katherine McCurdy , Oguz Serbetci

Word embedding, which converts words into numerical values, is an important natural language processing technique and widely used. One of the serious problems of word embedding is that the bias will be learned and affect the model if the…

Human-Computer Interaction · Computer Science 2025-06-04 Arisa Sugino , Takayuki Itoh

Self-supervised speaker embeddings are widely used in speaker verification systems, but prior work has shown that they often encode sensitive demographic attributes, raising fairness and privacy concerns. This paper investigates the extent…

We introduce a framework to measure how biases change before and after fine-tuning a large scale visual recognition model for a downstream task. Deep learning models trained on increasing amounts of data are known to encode societal biases.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Jaspreet Ranjit , Tianlu Wang , Baishakhi Ray , Vicente Ordonez

Language model debiasing has emerged as an important field of study in the NLP community. Numerous debiasing techniques were proposed, but bias ablation remains an unaddressed issue. We demonstrate a novel framework for inspecting bias in…

Computation and Language · Computer Science 2022-07-07 Przemyslaw Joniak , Akiko Aizawa

Image captioning models are known to perpetuate and amplify harmful societal bias in the training set. In this work, we aim to mitigate such gender bias in image captioning models. While prior work has addressed this problem by forcing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yusuke Hirota , Yuta Nakashima , Noa Garcia