English
Related papers

Related papers: How does Grammatical Gender Affect Noun Representa…

200 papers

Language models encode and subsequently perpetuate harmful gendered stereotypes. Research has succeeded in mitigating some of these harms, e.g. by dissociating non-gendered terms such as occupations from gendered terms such as 'woman' and…

Computation and Language · Computer Science 2025-05-21 Franziska Sofia Hafner , Ana Valdivia , Luc Rocher

Gender bias in word embeddings gradually becomes a vivid research field in recent years. Most studies in this field aim at measurement and debiasing methods with English as the target language. This paper investigates gender bias in static…

Computation and Language · Computer Science 2021-06-02 Meichun Jiao , Ziyang Luo

Despite widespread use in natural language processing (NLP) tasks, word embeddings have been criticized for inheriting unintended gender bias from training corpora. programmer is more closely associated with man and homemaker is more…

Computation and Language · Computer Science 2021-04-15 Haswanth Aekula , Sugam Garg , Animesh Gupta

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

This paper investigates biases of Large Language Models (LLMs) through the lens of grammatical gender. Drawing inspiration from seminal works in psycholinguistics, particularly the study of gender's influence on language perception, we…

Computation and Language · Computer Science 2024-07-16 Viktor Mihaylov , Aleksandar Shtedritski

Gender-neutral pronouns have recently been introduced in many languages to a) include non-binary people and b) as a generic singular. Recent results from psycholinguistics suggest that gender-neutral pronouns (in Swedish) are not associated…

Computation and Language · Computer Science 2022-05-04 Stephanie Brandl , Ruixiang Cui , Anders Søgaard

Word embeddings derived from human-generated corpora inherit strong gender bias which can be further amplified by downstream models. Some commonly adopted debiasing approaches, including the seminal Hard Debias algorithm, apply…

Computation and Language · Computer Science 2020-05-05 Tianlu Wang , Xi Victoria Lin , Nazneen Fatema Rajani , Bryan McCann , Vicente Ordonez , Caiming Xiong

The statistical regularities in language corpora encode well-known social biases into word embeddings. Here, we focus on gender to provide a comprehensive analysis of group-based biases in widely-used static English word embeddings trained…

Computers and Society · Computer Science 2022-06-08 Aylin Caliskan , Pimparkar Parth Ajay , Tessa Charlesworth , Robert Wolfe , Mahzarin R. Banaji

Reporting and providing test sets for harmful bias in NLP applications is essential for building a robust understanding of the current problem. We present a new observation of gender bias in a downstream NLP application: marked attribute…

Computation and Language · Computer Science 2021-09-30 Hillary Dawkins

Numerous works use word embedding-based metrics to quantify societal biases and stereotypes in texts. Recent studies have found that word embeddings can capture semantic similarity but may be affected by word frequency. In this work we…

Computation and Language · Computer Science 2023-01-03 Francisco Valentini , Germán Rosati , Diego Fernandez Slezak , Edgar Altszyler

Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstream tasks. Whereas…

Computation and Language · Computer Science 2020-11-04 Seungjae Shin , Kyungwoo Song , JoonHo Jang , Hyemi Kim , Weonyoung Joo , Il-Chul Moon

Word embeddings learnt from massive text collections have demonstrated significant levels of discriminative biases such as gender, racial or ethnic biases, which in turn bias the down-stream NLP applications that use those word embeddings.…

Computation and Language · Computer Science 2019-06-04 Masahiro Kaneko , Danushka Bollegala

We study the role of the second language in bilingual word embeddings in monolingual semantic evaluation tasks. We find strongly and weakly positive correlations between down-stream task performance and second language similarity to the…

Computation and Language · Computer Science 2016-10-12 Steffen Eger , Armin Hoenen , Alexander Mehler

We analyze the information provided by the word embeddings about the grammatical gender in Swedish. We wish that this paper may serve as one of the bridges to connect the methods of computational linguistics and general linguistics. Taking…

Computation and Language · Computer Science 2020-07-29 Marc Allassonnière-Tang , Ali Basirat

Word embeddings are extensively used in various NLP problems as a state-of-the-art semantic feature vector representation. Despite their success on various tasks and domains, they might exhibit an undesired bias for stereotypical categories…

Computation and Language · Computer Science 2022-12-16 Gizem Sogancioglu , Heysem Kaya

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Recent research in Natural Language Processing has revealed that word embeddings can encode social biases present in the training data which can affect minorities in real world applications. This paper explores the gender bias implicit in…

Computation and Language · Computer Science 2020-11-05 Rodrigo Alejandro Chávez Mulsa , Gerasimos Spanakis

Word embedding models have become a fundamental component in a wide range of Natural Language Processing (NLP) applications. However, embeddings trained on human-generated corpora have been demonstrated to inherit strong gender stereotypes…

Computation and Language · Computer Science 2018-09-06 Jieyu Zhao , Yichao Zhou , Zeyu Li , Wei Wang , Kai-Wei Chang

Word embeddings have been shown to produce remarkable results in tackling a vast majority of NLP related tasks. Unfortunately, word embeddings also capture the stereotypical biases that are prevalent in society, affecting the predictive…

Computation and Language · Computer Science 2024-11-20 Navya Yarrabelly , Vinay Damodaran , Feng-Guang Su