中文
相关论文

相关论文: Double-Hard Debias: Tailoring Word Embeddings for …

200 篇论文

This paper presents an algorithm for enumerating biases in word embeddings. The algorithm exposes a large number of offensive associations related to sensitive features such as race and gender on publicly available embeddings, including a…

计算与语言 · 计算机科学 2019-06-21 Nathaniel Swinger , Maria De-Arteaga , Neil Thomas Heffernan , Mark DM Leiserson , Adam Tauman Kalai

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

计算与语言 · 计算机科学 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

计算与语言 · 计算机科学 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

计算与语言 · 计算机科学 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung

Word embeddings are a fixed, distributional representation of the context of words in a corpus learned from word co-occurrences. While word embeddings have proven to have many practical uses in natural language processing tasks, they…

计算与语言 · 计算机科学 2020-10-02 James Powell , Kari Sentz

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

计算与语言 · 计算机科学 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

It has been shown that word embeddings can exhibit gender bias, and various methods have been proposed to quantify this. However, the extent to which the methods are capturing social stereotypes inherited from the data has been debated.…

计算与语言 · 计算机科学 2020-10-29 Haiyang Zhang , Alison Sneyd , Mark Stevenson

Word embeddings are the standard model for semantic and syntactic representations of words. Unfortunately, these models have been shown to exhibit undesirable word associations resulting from gender, racial, and religious biases. Existing…

计算与语言 · 计算机科学 2020-06-04 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar , Tanmoy Chakraborty

Recent research in Natural Language Processing has revealed that word embeddings can encode social biases present in the training data which can affect minorities in real world applications. This paper explores the gender bias implicit in…

计算与语言 · 计算机科学 2020-11-05 Rodrigo Alejandro Chávez Mulsa , Gerasimos Spanakis

Non-contextual word embedding models have been shown to inherit human-like stereotypical biases of gender, race and religion from the training corpora. To counter this issue, a large body of research has emerged which aims to mitigate these…

计算与语言 · 计算机科学 2020-10-27 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar

Word embeddings are a fixed, distributional representation of the context of words in a corpus learned from word co-occurrences. Despite their proven utility in machine learning tasks, word embedding models may capture uneven semantic and…

计算与语言 · 计算机科学 2021-10-07 James Powell , Kari Sentz , Martin Klein

Word vector representations are well developed tools for various NLP and Machine Learning tasks and are known to retain significant semantic and syntactic structure of languages. But they are prone to carrying and amplifying bias which can…

计算与语言 · 计算机科学 2019-01-24 Sunipa Dev , Jeff Phillips

Existing methods for debiasing word embeddings often do so only superficially, in that words that are stereotypically associated with, e.g., a particular gender in the original embedding space can still be clustered together in the debiased…

计算与语言 · 计算机科学 2020-06-23 Yuhao Du , Kenneth Joseph

Does the grammatical gender of a language interfere when measuring the semantic gender information captured by its word embeddings? A number of anomalous gender bias measurements in the embeddings of gendered languages suggest this…

计算机与社会 · 计算机科学 2022-06-06 Shiva Omrani Sabbaghi , Aylin Caliskan

Current advances in Natural Language Processing (NLP) have made it increasingly feasible to build applications leveraging textual data. Generally, the core of these applications rely on having a good semantic representation of text into…

计算与语言 · 计算机科学 2024-10-21 Thomas Uriot

Online texts -- across genres, registers, domains, and styles -- are riddled with human stereotypes, expressed in overt or subtle ways. Word embeddings, trained on these texts, perpetuate and amplify these stereotypes, and propagate biases…

计算与语言 · 计算机科学 2019-07-03 Thomas Manzini , Yao Chong Lim , Yulia Tsvetkov , Alan W Black

In recent years, pretrained word embeddings have proved useful for multimodal neural machine translation (NMT) models to address the shortage of available datasets. However, the integration of pretrained word embeddings has not yet been…

计算与语言 · 计算机科学 2019-06-25 Tosho Hirasawa , Mamoru Komachi

Societal biases in the usage of words, including harmful stereotypes, are frequently learned by common word embedding methods. These biases manifest not only between a word and an explicit marker of its stereotype, but also between words…

计算与语言 · 计算机科学 2023-05-25 Erin George , Joyce Chew , Deanna Needell

Over the last years, various sentence embedders have been an integral part in the success of current machine learning approaches to Natural Language Processing (NLP). Unfortunately, multiple sources have shown that the bias, inherent in the…

计算与语言 · 计算机科学 2024-03-28 Philip Kenneweg , Sarah Schröder , Alexander Schulz , Barbara Hammer

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

计算与语言 · 计算机科学 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene