English
Related papers

Related papers: Beyond Binary Gender: Evaluating Gender-Inclusive …

200 papers

This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. We find evidence that gender stereotype…

Computation and Language · Computer Science 2021-02-17 Daniel de Vassimon Manela , David Errington , Thomas Fisher , Boris van Breugel , Pasquale Minervini

Language has a profound impact on our thoughts, perceptions, and conceptions of gender roles. Gender-inclusive language is, therefore, a key tool to promote social inclusion and contribute to achieving gender equality. Consequently,…

Computation and Language · Computer Science 2023-02-24 Jad Doughman , Wael Khreich

Large Language Models (LLMs) are increasingly utilized in educational tasks such as providing writing suggestions to students. Despite their potential, LLMs are known to harbor inherent biases which may negatively impact learners. Previous…

Computation and Language · Computer Science 2023-11-07 Thiemo Wambsganss , Xiaotian Su , Vinitra Swamy , Seyed Parsa Neshaei , Roman Rietsche , Tanja Käser

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

In this multicultural age, language translation is one of the most performed tasks, and it is becoming increasingly AI-moderated and automated. As a novel AI system, ChatGPT claims to be proficient in such translation tasks and in this…

Computers and Society · Computer Science 2024-08-06 Sourojit Ghosh , Aylin Caliskan

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

Accurately measuring gender stereotypical bias in language models is a complex task with many hidden aspects. Current benchmarks have underestimated this multifaceted challenge and failed to capture the full extent of the problem. This…

Computation and Language · Computer Science 2025-09-25 Mahdi Zakizadeh , Mohammad Taher Pilehvar

This work sets the ground for studying how explicit grammatical gender assignment in job titles can affect the results of automatic job ranking systems. We propose the usage of metrics for ranking comparison controlling for gender to…

Computation and Language · Computer Science 2025-09-18 Laura García-Sardiña , Hermenegildo Fabregat , Daniel Deniz , Rabih Zbib

In this work, we investigate the correlation between gender and contextual biases, focusing on elements such as action verbs, object nouns, and particularly on occupations. We introduce a novel dataset, GenderLexicon, and a framework that…

Computation and Language · Computer Science 2025-07-15 Ahmed Sabir , Rajesh Sharma

Numerous works have analyzed biases in vision and pre-trained language models individually - however, less attention has been paid to how these biases interact in multimodal settings. This work extends text-based bias analysis methods to…

Computation and Language · Computer Science 2022-05-23 Tejas Srinivasan , Yonatan Bisk

Gender bias in language models has gained increasing attention in the field of natural language processing. Encoder-based transformer models, which have achieved state-of-the-art performance in various language tasks, have been shown to…

Gender-neutral translation (GNT) that avoids biased and undue binary assumptions is a pivotal challenge for the creation of more inclusive translation technologies. Advancements for this task in Machine Translation (MT), however, are…

Computation and Language · Computer Science 2024-02-12 Beatrice Savoldi , Andrea Piergentili , Dennis Fucci , Matteo Negri , Luisa Bentivogli

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

The problem of gender bias is highly prevalent and well known. In this paper, we have analysed the portrayal of gender roles in English movies, a medium that effectively influences society in shaping people's beliefs and opinions. First, we…

Computation and Language · Computer Science 2022-11-24 Muhammad Junaid Haris , Aanchal Upreti , Melih Kurtaran , Filip Ginter , Sebastien Lafond , Sepinoud Azimi

Automatic Gender Recognition (AGR) systems are an increasingly widespread application in the Machine Learning (ML) landscape. While these systems are typically understood as detecting gender, they often classify datapoints based on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Camilla Quaresmini , Giacomo Zanotti

This study delves into the pervasive issue of gender issues in artificial intelligence (AI), specifically within automatic scoring systems for student-written responses. The primary objective is to investigate the presence of gender biases,…

Computers and Society · Computer Science 2025-01-29 Ehsan Latif , Xiaoming Zhai , Lei Liu

Sense embedding learning methods learn different embeddings for the different senses of an ambiguous word. One sense of an ambiguous word might be socially biased while its other senses remain unbiased. In comparison to the numerous prior…

Computation and Language · Computer Science 2022-03-17 Yi Zhou , Masahiro Kaneko , Danushka Bollegala

Language can be used as a means of reproducing and enforcing harmful stereotypes and biases and has been analysed as such in numerous research. In this paper, we present a survey of 304 papers on gender bias in natural language processing.…

Computation and Language · Computer Science 2021-12-30 Karolina Stanczak , Isabelle Augenstein

Gender bias research has been pivotal in revealing undesirable behaviors in large language models, exposing serious gender stereotypes associated with occupations, and emotions. A key observation in prior work is that models reinforce…

Computation and Language · Computer Science 2024-05-02 Catarina G Belém , Preethi Seshadri , Yasaman Razeghi , Sameer Singh

Large Language Models (LLMs) have achieved significant success in recent years; yet, issues of intrinsic gender bias persist, especially in non-English languages. Although current research mostly emphasizes English, the linguistic and…

Computation and Language · Computer Science 2026-01-27 Md Asgor Hossain Reaj , Rajan Das Gupta , Jui Saha Pritha , Abdullah Al Noman , Abir Ahmed , Golam Md Mohiuddin , Tze Hui Liew