English
Related papers

Related papers: On Evaluating and Mitigating Gender Biases in Mult…

200 papers

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

Masked Language Models (MLMs) pre-trained by predicting masked tokens on large corpora have been used successfully in natural language processing tasks for a variety of languages. Unfortunately, it was reported that MLMs also learn…

Computation and Language · Computer Science 2022-05-05 Masahiro Kaneko , Aizhan Imankulova , Danushka Bollegala , Naoaki Okazaki

Sentiment analysis (SA) systems are used in many products and hundreds of languages. Gender and racial biases are well-studied in English SA systems, but understudied in other languages, with few resources for such studies. To remedy this,…

Computation and Language · Computer Science 2023-05-22 Seraphina Goldfarb-Tarrant , Adam Lopez , Roi Blanco , Diego Marcheggiani

Mitigation of biases, such as language models' reliance on gender stereotypes, is a crucial endeavor required for the creation of reliable and useful language technology. The crucial aspect of debiasing is to ensure that the models preserve…

Computation and Language · Computer Science 2025-02-03 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

Computation and Language · Computer Science 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Gender bias has been a focal point in the study of bias in machine translation and language models. Existing machine translation gender bias evaluations are primarily focused on male and female genders, limiting the scope of the evaluation.…

Computation and Language · Computer Science 2024-07-24 Yijie Chen , Yijin Liu , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Large Language Models (LLMs) have achieved significant success in recent years; yet, issues of intrinsic gender bias persist, especially in non-English languages. Although current research mostly emphasizes English, the linguistic and…

Computation and Language · Computer Science 2026-01-27 Md Asgor Hossain Reaj , Rajan Das Gupta , Jui Saha Pritha , Abdullah Al Noman , Abir Ahmed , Golam Md Mohiuddin , Tze Hui Liew

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

Computation and Language · Computer Science 2023-11-28 Ananya Malik

Bias studies on multilingual models confirm the presence of gender-related stereotypes in masked models processing languages with high NLP resources. We expand on this line of research by introducing Filipino CrowS-Pairs and Filipino…

Computation and Language · Computer Science 2025-04-29 Lance Calvin Lim Gamboa , Mark Lee

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

The scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups. Currently, there are no standard evaluation techniques for different types of biases.…

Computation and Language · Computer Science 2022-05-17 Marta R. Costa-jussà , Christine Basta , Gerard I. Gállego

Sentiment analysis (SA) systems are widely deployed in many of the world's languages, and there is well-documented evidence of demographic bias in these systems. In languages beyond English, scarcer training data is often supplemented with…

Computation and Language · Computer Science 2023-05-23 Seraphina Goldfarb-Tarrant , Björn Ross , Adam Lopez

Lack of diverse perspectives causes neutrality bias in Wikipedia content leading to millions of worldwide readers getting exposed by potentially inaccurate information. Hence, neutrality bias detection and mitigation is a critical problem.…

Computation and Language · Computer Science 2023-12-27 Ankita Maity , Anubhav Sharma , Rudra Dhar , Tushar Abhishek , Manish Gupta , Vasudeva Varma

Accurately measuring gender stereotypical bias in language models is a complex task with many hidden aspects. Current benchmarks have underestimated this multifaceted challenge and failed to capture the full extent of the problem. This…

Computation and Language · Computer Science 2025-09-25 Mahdi Zakizadeh , Mohammad Taher Pilehvar

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

The advancement of Large Language Models (LLMs) has transformed Natural Language Processing (NLP), enabling performance across diverse tasks with little task-specific training. However, LLMs remain susceptible to social biases, particularly…

Computation and Language · Computer Science 2025-07-08 Melanie Galea , Claudia Borg

Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in…

Computation and Language · Computer Science 2023-04-13 Inna Wanyin Lin , Lucille Njoo , Anjalie Field , Ashish Sharma , Katharina Reinecke , Tim Althoff , Yulia Tsvetkov

Gender bias in pretrained language models (PLMs) poses significant social and ethical challenges. Despite growing awareness, there is a lack of comprehensive investigation into how different models internally represent and propagate such…

Computation and Language · Computer Science 2025-03-11 Mahdi Zakizadeh , Mohammad Taher Pilehvar