English
Related papers

Related papers: Gender Bias in Contextualized Word Embeddings

200 papers

Our society is plagued by several biases, including racial biases, caste biases, and gender bias. As a matter of fact, several years ago, most of these notions were unheard of. These biases passed through generations along with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Lavisha Aggarwal , Shruti Bhargava

Recent instruction fine-tuned models can solve multiple NLP tasks when prompted to do so, with machine translation (MT) being a prominent use case. However, current research often focuses on standard performance benchmarks, leaving…

Computation and Language · Computer Science 2023-10-26 Giuseppe Attanasio , Flor Miriam Plaza-del-Arco , Debora Nozza , Anne Lauscher

Model-based evaluation metrics (e.g., CLIPScore and GPTScore) have demonstrated decent correlations with human judgments in various language generation tasks. However, their impact on fairness remains largely unexplored. It is widely…

Computation and Language · Computer Science 2023-11-06 Haoyi Qiu , Zi-Yi Dou , Tianlu Wang , Asli Celikyilmaz , Nanyun Peng

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Correctly resolving textual mentions of people fundamentally entails making inferences about those people. Such inferences raise the risk of systemic biases in coreference resolution systems, including biases that can harm binary and…

Computation and Language · Computer Science 2020-12-03 Yang Trista Cao , Hal Daumé

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

We generalize the notion of social biases from language embeddings to grounded vision and language embeddings. Biases are present in grounded embeddings, and indeed seem to be equally or more significant than for ungrounded embeddings. This…

Computation and Language · Computer Science 2023-08-23 Candace Ross , Boris Katz , Andrei Barbu

The awareness and mitigation of biases are of fundamental importance for the fair and transparent use of contextual language models, yet they crucially depend on the accurate detection of biases as a precursor. Consequently, numerous bias…

Computation and Language · Computer Science 2022-11-17 Silke Husse , Andreas Spitz

Contemporary debates on filter bubbles and polarization in public and social media raise the question to what extent news media of the past exhibited biases. This paper specifically examines bias related to gender in six Dutch national…

Computation and Language · Computer Science 2019-07-23 Melvin Wevers

Text corpora are widely used resources for measuring societal biases and stereotypes. The common approach to measuring such biases using a corpus is by calculating the similarities between the embedding vector of a word (like nurse) and the…

Computation and Language · Computer Science 2021-04-28 Navid Rekabsaz , Robert West , James Henderson , Allan Hanbury

Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across different…

Computation and Language · Computer Science 2020-08-11 Shubhanshu Mishra , Sijun He , Luca Belli

It has been shown that word embeddings derived from large corpora tend to incorporate biases present in their training data. Various methods for mitigating these biases have been proposed, but recent work has demonstrated that these methods…

Computation and Language · Computer Science 2023-06-27 Hailey Joren , David Alvarez-Melis

Current advances in Natural Language Processing (NLP) have made it increasingly feasible to build applications leveraging textual data. Generally, the core of these applications rely on having a good semantic representation of text into…

Computation and Language · Computer Science 2024-10-21 Thomas Uriot

Intersectional bias is a bias caused by an overlap of multiple social factors like gender, sexuality, race, disability, religion, etc. A recent study has shown that word embedding models can be laden with biases against intersectional…

Computation and Language · Computer Science 2021-09-08 Bhavya Ghai , Md Naimul Hoque , Klaus Mueller

This research delves into the reduction of machine learning model bias through Ensemble Learning. Our rigorous methodology comprehensively assesses bias across various categorical variables, ultimately revealing a pronounced gender…

Computers and Society · Computer Science 2023-10-17 Sahil Girhepuje

Cross-lingual word embeddings (CLWE) have been proven useful in many cross-lingual tasks. However, most existing approaches to learn CLWE including the ones with contextual embeddings are sense agnostic. In this work, we propose a novel…

Computation and Language · Computer Science 2022-09-16 Linlin Liu , Thien Hai Nguyen , Shafiq Joty , Lidong Bing , Luo Si

Gender bias in large language models has primarily been investigated for English, while languages with grammatical or morphological gender remain comparatively understudied. This paper investigates how and when gender information emerges in…

Computation and Language · Computer Science 2026-05-11 Jonas Klein , Chiara Manna , Eva Vanmassenhove

Human biases are ubiquitous but not uniform: disparities exist across linguistic, cultural, and societal borders. As large amounts of recent literature suggest, language models (LMs) trained on human data can reflect and often amplify the…

Computation and Language · Computer Science 2023-10-27 Anjishnu Mukherjee , Chahat Raj , Ziwei Zhu , Antonios Anastasopoulos

The problem of gender bias is highly prevalent and well known. In this paper, we have analysed the portrayal of gender roles in English movies, a medium that effectively influences society in shaping people's beliefs and opinions. First, we…

Computation and Language · Computer Science 2022-11-24 Muhammad Junaid Haris , Aanchal Upreti , Melih Kurtaran , Filip Ginter , Sebastien Lafond , Sepinoud Azimi

Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in…

Computation and Language · Computer Science 2023-04-13 Inna Wanyin Lin , Lucille Njoo , Anjalie Field , Ashish Sharma , Katharina Reinecke , Tim Althoff , Yulia Tsvetkov