English
Related papers

Related papers: On Measuring Social Biases in Sentence Encoders

200 papers

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

Computation and Language · Computer Science 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar

Artificial intelligence and machine learning are in a period of astounding growth. However, there are concerns that these technologies may be used, either with or without intention, to perpetuate the prejudice and unfairness that…

Artificial Intelligence · Computer Science 2017-05-26 Aylin Caliskan , Joanna J. Bryson , Arvind Narayanan

Recent studies have shown that word embeddings exhibit gender bias inherited from the training corpora. However, most studies to date have focused on quantifying and mitigating such bias only in English. These analyses cannot be directly…

Computation and Language · Computer Science 2019-09-11 Pei Zhou , Weijia Shi , Jieyu Zhao , Kuan-Hao Huang , Muhao Chen , Ryan Cotterell , Kai-Wei Chang

Many studies have revealed that word embeddings, language models, and models for specific downstream tasks in NLP are prone to social biases, especially gender bias. Recently these techniques have been gradually applied to automatic…

Computation and Language · Computer Science 2022-10-18 Mingqi Gao , Xiaojun Wan

Social bias in machine learning has drawn significant attention, with work ranging from demonstrations of bias in a multitude of applications, curating definitions of fairness for different contexts, to developing algorithms to mitigate…

Computation and Language · Computer Science 2019-11-06 Yi Chern Tan , L. Elisa Celis

Sense embedding learning methods learn different embeddings for the different senses of an ambiguous word. One sense of an ambiguous word might be socially biased while its other senses remain unbiased. In comparison to the numerous prior…

Computation and Language · Computer Science 2022-03-17 Yi Zhou , Masahiro Kaneko , Danushka Bollegala

Gender bias is highly impacting natural language processing applications. Word embeddings have clearly been proven both to keep and amplify gender biases that are present in current data sources. Recently, contextualized word embeddings…

Computation and Language · Computer Science 2019-04-19 Christine Basta , Marta R. Costa-jussà , Noe Casas

Bias in word embeddings such as Word2Vec has been widely investigated, and many efforts made to remove such bias. We show how to use conceptors debiasing to post-process both traditional and contextualized word embeddings. Our conceptor…

Computation and Language · Computer Science 2019-06-17 Saket Karve , Lyle Ungar , João Sedoc

This paper presents an algorithm for enumerating biases in word embeddings. The algorithm exposes a large number of offensive associations related to sensitive features such as race and gender on publicly available embeddings, including a…

Computation and Language · Computer Science 2019-06-21 Nathaniel Swinger , Maria De-Arteaga , Neil Thomas Heffernan , Mark DM Leiserson , Adam Tauman Kalai

It has been shown that word embeddings can exhibit gender bias, and various methods have been proposed to quantify this. However, the extent to which the methods are capturing social stereotypes inherited from the data has been debated.…

Computation and Language · Computer Science 2020-10-29 Haiyang Zhang , Alison Sneyd , Mark Stevenson

In this paper, we quantify, analyze and mitigate gender bias exhibited in ELMo's contextualized word vectors. First, we conduct several intrinsic analyses and find that (1) training data for ELMo contains significantly more male than female…

Computation and Language · Computer Science 2019-04-09 Jieyu Zhao , Tianlu Wang , Mark Yatskar , Ryan Cotterell , Vicente Ordonez , Kai-Wei Chang

Static word embeddings are ubiquitous in computational social science applications and contribute to practical decision-making in a variety of fields including law and healthcare. However, assessing the statistical uncertainty in downstream…

Computation and Language · Computer Science 2024-06-19 Andrea Vallebueno , Cassandra Handan-Nader , Christopher D. Manning , Daniel E. Ho

Text embedding models from Natural Language Processing can map text data (e.g. words, sentences, documents) to supposedly meaningful numerical representations (a.k.a. text embeddings). While such models are increasingly applied in social…

Computers and Society · Computer Science 2023-01-24 Qixiang Fang , Dong Nguyen , Daniel L Oberski

Numerous works use word embedding-based metrics to quantify societal biases and stereotypes in texts. Recent studies have found that word embeddings can capture semantic similarity but may be affected by word frequency. In this work we…

Computation and Language · Computer Science 2023-01-03 Francisco Valentini , Germán Rosati , Diego Fernandez Slezak , Edgar Altszyler

With the starting point that implicit human biases are reflected in the statistical regularities of language, it is possible to measure biases in English static word embeddings. State-of-the-art neural language models generate dynamic word…

Computers and Society · Computer Science 2021-05-20 Wei Guo , Aylin Caliskan

Recent research in Natural Language Processing has revealed that word embeddings can encode social biases present in the training data which can affect minorities in real world applications. This paper explores the gender bias implicit in…

Computation and Language · Computer Science 2020-11-05 Rodrigo Alejandro Chávez Mulsa , Gerasimos Spanakis

Recent work has shown that distributional word vector spaces often encode human biases like sexism or racism. In this work, we conduct an extensive analysis of biases in Arabic word embeddings by applying a range of recently introduced bias…

Computation and Language · Computer Science 2020-11-04 Anne Lauscher , Rafik Takieddin , Simone Paolo Ponzetto , Goran Glavaš

Does the grammatical gender of a language interfere when measuring the semantic gender information captured by its word embeddings? A number of anomalous gender bias measurements in the embeddings of gendered languages suggest this…

Computers and Society · Computer Science 2022-06-06 Shiva Omrani Sabbaghi , Aylin Caliskan

Sentiment analysis is one of the well-known tasks and fast growing research areas in natural language processing (NLP) and text classifications. This technique has become an essential part of a wide range of applications including politics,…

Computation and Language · Computer Science 2017-11-27 Seyed Mahdi Rezaeinia , Ali Ghodsi , Rouhollah Rahmani

Various measures have been proposed to quantify human-like social biases in word embeddings. However, bias scores based on these measures can suffer from measurement error. One indication of measurement quality is reliability, concerning…

Computation and Language · Computer Science 2021-09-13 Yupei Du , Qixiang Fang , Dong Nguyen
‹ Prev 1 2 3 10 Next ›