English
Related papers

Related papers: Gender Bias in Contextualized Word Embeddings

200 papers

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Word embedding models have become a fundamental component in a wide range of Natural Language Processing (NLP) applications. However, embeddings trained on human-generated corpora have been demonstrated to inherit strong gender stereotypes…

Computation and Language · Computer Science 2018-09-06 Jieyu Zhao , Yichao Zhou , Zeyu Li , Wei Wang , Kai-Wei Chang

Static word embeddings encode word associations, extensively utilized in downstream NLP tasks. Although prior studies have discussed the nature of such word associations in terms of biases and lexical regularities captured, the variation in…

Computation and Language · Computer Science 2020-12-16 Geetanjali Bihani , Julia Taylor Rayz

Numerous types of social biases have been identified in pre-trained language models (PLMs), and various intrinsic bias evaluation measures have been proposed for quantifying those social biases. Prior works have relied on human annotated…

Computation and Language · Computer Science 2023-01-31 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

We present a new local entity disambiguation system. The key to our system is a novel approach for learning entity representations. In our approach we learn an entity aware extension of Embedding for Language Model (ELMo) which we call…

Computation and Language · Computer Science 2019-08-23 Hamed Shahbazi , Xiaoli Z. Fern , Reza Ghaeini , Rasha Obeidat , Prasad Tadepalli

Due to their similarity-based learning objectives, pretrained sentence encoders often internalize stereotypical assumptions that reflect the social biases that exist within their training corpora. In this paper, we describe several kinds of…

Computation and Language · Computer Science 2023-03-13 Hongyin Luo , James Glass

Language models (LMs) have become pivotal in the realm of technological advancements. While their capabilities are vast and transformative, they often include societal biases encoded in the human-produced datasets used for their training.…

Computation and Language · Computer Science 2024-01-30 Iñigo Parra

We introduce VisoGender, a novel dataset for benchmarking gender bias in vision-language models. We focus on occupation-related biases within a hegemonic system of binary gender, inspired by Winograd and Winogender schemas, where each image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Siobhan Mackenzie Hall , Fernanda Gonçalves Abrantes , Hanwen Zhu , Grace Sodunke , Aleksandar Shtedritski , Hannah Rose Kirk

While measuring bias and robustness in coreference resolution are important goals, such measurements are only as good as the tools we use to measure them. Winogender Schemas (Rudinger et al., 2018) are an influential dataset proposed to…

Computation and Language · Computer Science 2024-10-08 Vagrant Gautam , Julius Steuer , Eileen Bingert , Ray Johns , Anne Lauscher , Dietrich Klakow

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

Computation and Language · Computer Science 2021-07-27 Jonas-Dario Troles , Ute Schmid

Gender bias has been a focal point in the study of bias in machine translation and language models. Existing machine translation gender bias evaluations are primarily focused on male and female genders, limiting the scope of the evaluation.…

Computation and Language · Computer Science 2024-07-24 Yijie Chen , Yijin Liu , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Contextualized word embeddings derived from pre-trained language models (LMs) show significant improvements on downstream NLP tasks. Pre-training on domain-specific corpora, such as biomedical articles, further improves their performance.…

Computation and Language · Computer Science 2019-04-05 Qiao Jin , Bhuwan Dhingra , William W. Cohen , Xinghua Lu

Replacing static word embeddings with contextualized word representations has yielded significant improvements on many NLP tasks. However, just how contextual are the contextualized representations produced by models such as ELMo and BERT?…

Computation and Language · Computer Science 2019-09-04 Kawin Ethayarajh

Large Language Models (LLMs) have been shown to be biased in prior work, as they generate text that is in line with stereotypical views of the world or that is not representative of the viewpoints and values of historically marginalized…

Computation and Language · Computer Science 2025-02-07 Laura Biester

Accurately measuring gender stereotypical bias in language models is a complex task with many hidden aspects. Current benchmarks have underestimated this multifaceted challenge and failed to capture the full extent of the problem. This…

Computation and Language · Computer Science 2025-09-25 Mahdi Zakizadeh , Mohammad Taher Pilehvar

Gender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt a…

Computation and Language · Computer Science 2022-03-21 Beatrice Savoldi , Marco Gaido , Luisa Bentivogli , Matteo Negri , Marco Turchi

Different methods have been proposed to develop meta-embeddings from a given set of source embeddings. However, the source embeddings can contain unfair gender-related biases, and how these influence the meta-embeddings has not been studied…

Computation and Language · Computer Science 2022-10-07 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

We use the multilingual OSCAR corpus, extracted from Common Crawl via language classification, filtering and cleaning, to train monolingual contextualized word embeddings (ELMo) for five mid-resource languages. We then compare the…

Computation and Language · Computer Science 2020-08-24 Pedro Javier Ortiz Suárez , Laurent Romary , Benoît Sagot

Language carries implicit human biases, functioning both as a reflection and a perpetuation of stereotypes that people carry with them. Recently, ML-based NLP methods such as word embeddings have been shown to learn such language biases…

Computation and Language · Computer Science 2022-01-26 Xavier Ferrer-Aran , Tom van Nuenen , Natalia Criado , Jose M. Such

Vision-language models (VLM) align images and text in a shared representation space that is useful for retrieval and zero-shot transfer. Yet, this alignment can encode and amplify social stereotypes in subtle ways that are not obvious from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Aiswarya Konavoor , Raj Abhijit Dandekar , Rajat Dandekar , Sreedath Panat