English
Related papers

Related papers: A Survey on Gender Bias in Natural Language Proces…

200 papers

Although large pre-trained language models have achieved great success in many NLP tasks, it has been shown that they reflect human biases from their pre-training corpora. This bias may lead to undesirable outcomes when these models are…

Computation and Language · Computer Science 2022-11-29 Aristides Milios , Parishad BehnamGhader

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

Recent works have found evidence of gender bias in models of machine translation and coreference resolution using mostly synthetic diagnostic datasets. While these quantify bias in a controlled experiment, they often do so on a small scale…

Computation and Language · Computer Science 2021-09-13 Shahar Levy , Koren Lazar , Gabriel Stanovsky

Bias research in NLP seeks to analyse models for social biases, thus helping NLP practitioners uncover, measure, and mitigate social harms. We analyse the body of work that uses prompts and templates to assess bias in language models. We…

Computation and Language · Computer Science 2023-05-23 Seraphina Goldfarb-Tarrant , Eddie Ungless , Esma Balkir , Su Lin Blodgett

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

Computation and Language · Computer Science 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts. While psycholinguistic studies have examined its effects in relation to human cognition,…

Computation and Language · Computer Science 2025-02-19 Marion Bartl , Thomas Brendan Murphy , Susan Leavy

As Machine Learning technologies become increasingly used in contexts that affect citizens, companies as well as researchers need to be confident that their application of these methods will not have unexpected social implications, such as…

Machine Learning · Computer Science 2025-03-06 Simon Caton , Christian Haas

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

Language serves as a powerful tool for the manifestation of societal belief systems. In doing so, it also perpetuates the prevalent biases in our society. Gender bias is one of the most pervasive biases in our society and is seen in online…

Computation and Language · Computer Science 2023-10-27 Rishav Hada , Agrima Seth , Harshita Diddee , Kalika Bali

As LLMs are increasingly applied in socially impactful settings, concerns about gender bias have prompted growing efforts both to measure and mitigate such bias. These efforts often rely on evaluation tasks that differ from natural language…

Computation and Language · Computer Science 2025-09-11 Bufan Gao , Elisa Kreiss

Natural Language Processing (NLP) is revolutionising the way both professionals and laypersons operate in the legal field. The considerable potential for NLP in the legal sector, especially in developing computational assistance tools for…

Computation and Language · Computer Science 2025-12-12 Farid Ariai , Joel Mackenzie , Gianluca Demartini

Word embeddings are extensively used in various NLP problems as a state-of-the-art semantic feature vector representation. Despite their success on various tasks and domains, they might exhibit an undesired bias for stereotypical categories…

Computation and Language · Computer Science 2022-12-16 Gizem Sogancioglu , Heysem Kaya

We survey the treatment of sex and gender in the Computer Graphics research literature from an algorithmic fairness perspective. The established practices on the use of gender and sex in our community are scientifically incorrect and…

Graphics · Computer Science 2022-06-02 Ana Dodik , Silvia Sellán , Theodore Kim , Amanda Phillips

Gender bias in natural language processing (NLP) applications, particularly machine translation, has been receiving increasing attention. Much of the research on this issue has focused on mitigating gender bias in English NLP models and…

Computation and Language · Computer Science 2021-10-19 Bashar Alhafni , Nizar Habash , Houda Bouamor

Information access research (and development) sometimes makes use of gender, whether to report on the demographics of participants in a user study, as inputs to personalized results or recommendations, or to make systems gender-fair,…

Information Retrieval · Computer Science 2023-01-18 Christine Pinney , Amifa Raj , Alex Hanna , Michael D. Ekstrand