中文
相关论文

相关论文: Gender-preserving Debiasing for Pre-trained Word E…

200 篇论文

Mitigating biases in machine learning models has become an increasing concern in Natural Language Processing (NLP), particularly in developing fair text embeddings, which are crucial yet challenging for real-world applications like search…

计算与语言 · 计算机科学 2024-06-25 Wenlong Deng , Blair Chen , Beidi Zhao , Chiyu Zhang , Xiaoxiao Li , Christos Thrampoulidis

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

机器学习 · 计算机科学 2021-05-03 Maarten Buyl , Tijl De Bie

Pretrained Language Models (PLMs) are widely used in NLP for various tasks. Recent studies have identified various biases that such models exhibit and have proposed methods to correct these biases. However, most of the works address a…

计算与语言 · 计算机科学 2024-02-13 Prachi Jain , Ashutosh Sathe , Varun Gumma , Kabir Ahuja , Sunayana Sitaram

Internet search affects people's cognition of the world, so mitigating biases in search results and learning fair models is imperative for social good. We study a unique gender bias in image search in this work: the search images are often…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Jialu Wang , Yang Liu , Xin Eric Wang

In this paper, we advance the current state-of-the-art method for debiasing monolingual word embeddings so as to generalize well in a multilingual setting. We consider different methods to quantify bias and different debiasing approaches…

计算与语言 · 计算机科学 2021-07-23 Srijan Bansal , Vishal Garimella , Ayush Suhane , Animesh Mukherjee

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstream tasks like text…

计算与语言 · 计算机科学 2023-01-31 Ewoenam Tokpo , Pieter Delobelle , Bettina Berendt , Toon Calders

Societal biases in the usage of words, including harmful stereotypes, are frequently learned by common word embedding methods. These biases manifest not only between a word and an explicit marker of its stereotype, but also between words…

计算与语言 · 计算机科学 2023-05-25 Erin George , Joyce Chew , Deanna Needell

It has been shown that word embeddings derived from large corpora tend to incorporate biases present in their training data. Various methods for mitigating these biases have been proposed, but recent work has demonstrated that these methods…

计算与语言 · 计算机科学 2023-06-27 Hailey Joren , David Alvarez-Melis

Gender bias in word embeddings gradually becomes a vivid research field in recent years. Most studies in this field aim at measurement and debiasing methods with English as the target language. This paper investigates gender bias in static…

计算与语言 · 计算机科学 2021-06-02 Meichun Jiao , Ziyang Luo

Word embeddings are often criticized for capturing undesirable word associations such as gender stereotypes. However, methods for measuring and removing such biases remain poorly understood. We show that for any embedding model that…

计算与语言 · 计算机科学 2019-08-20 Kawin Ethayarajh , David Duvenaud , Graeme Hirst

Many studies have revealed that word embeddings, language models, and models for specific downstream tasks in NLP are prone to social biases, especially gender bias. Recently these techniques have been gradually applied to automatic…

计算与语言 · 计算机科学 2022-10-18 Mingqi Gao , Xiaojun Wan

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

机器学习 · 计算机科学 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

Text-to-image diffusion models, which are theoretically equivalent to score-based generative models, generate images through a multi-step denoising process guided by text embeddings extracted from pretrained vision-language models such as…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Seung Hyuk Lee , Songkuk Kim

Clinical word embeddings are extensively used in various Bio-NLP problems as a state-of-the-art feature vector representation. Although they are quite successful at the semantic representation of words, due to the dataset - which…

计算与语言 · 计算机科学 2022-08-09 Gizem Sogancioglu , Fabian Mijsters , Amar van Uden , Jelle Peperzak

Large language models (LLMs) exhibit social biases that reinforce harmful stereotypes, limiting their safe deployment. Most existing debiasing methods adopt a suppressive paradigm by modifying parameters, prompts, or neurons associated with…

人工智能 · 计算机科学 2026-01-30 Jinhao Pan , Chahat Raj , Anjishnu Mukherjee , Sina Mansouri , Bowen Wei , Shloka Yada , Ziwei Zhu

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

计算与语言 · 计算机科学 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

Recent research efforts in NLP have demonstrated that distributional word vector spaces often encode stereotypical human biases, such as racism and sexism. With word representations ubiquitously used in NLP models and pipelines, this raises…

计算与语言 · 计算机科学 2021-03-12 Niklas Friedrich , Anne Lauscher , Simone Paolo Ponzetto , Goran Glavaš

Text embedding is becoming an increasingly popular AI methodology, especially among businesses, yet the potential of text embedding models to be biased is not well understood. This paper examines the degree to which a selection of popular…

人工智能 · 计算机科学 2024-06-19 Vasyl Rakivnenko , Nestor Maslej , Jessica Cervi , Volodymyr Zhukov

While Large Language Models achieve state-of-the-art results across a wide range of NLP tasks, they remain prone to systematic biases. Among these, gender bias is particularly salient in MT, due to systematic differences across languages in…

计算与语言 · 计算机科学 2026-03-19 Chiara Manna , Hosein Mohebbi , Afra Alishahi , Frédéric Blain , Eva Vanmassenhove

Numerous debiasing techniques have been proposed to mitigate the gender bias that is prevalent in pretrained language models. These are often evaluated on datasets that check the extent to which the model is gender-neutral in its…

计算与语言 · 计算机科学 2023-10-24 Mahdi Zakizadeh , Kaveh Eskandari Miandoab , Mohammad Taher Pilehvar