English
Related papers

Related papers: Reducing Gender Bias in Abusive Language Detection

200 papers

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and amplify social…

Computation and Language · Computer Science 2019-06-19 Keita Kurita , Nidhi Vyas , Ayush Pareek , Alan W Black , Yulia Tsvetkov

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov

Bias in Word Embeddings has been a subject of recent interest, along with efforts for its reduction. Current approaches show promising progress towards debiasing single bias dimensions such as gender or race. In this paper, we present a…

Computation and Language · Computer Science 2020-03-26 Radomir Popović , Florian Lemmerich , Markus Strohmaier

Pre-trained models have revolutionized natural language understanding. However, researchers have found they can encode artifacts undesired in many applications, such as professions correlating with one gender more than another. We explore…

Computation and Language · Computer Science 2021-03-04 Kellie Webster , Xuezhi Wang , Ian Tenney , Alex Beutel , Emily Pitler , Ellie Pavlick , Jilin Chen , Ed Chi , Slav Petrov

With the proliferation of social media, there has been a sharp increase in offensive content, particularly targeting vulnerable groups, exacerbating social problems such as hatred, racism, and sexism. Detecting offensive language use is…

Computation and Language · Computer Science 2023-12-05 Toygar Tanyel , Besher Alkurdi , Serkan Ayvaz

Gender bias research has been pivotal in revealing undesirable behaviors in large language models, exposing serious gender stereotypes associated with occupations, and emotions. A key observation in prior work is that models reinforce…

Computation and Language · Computer Science 2024-05-02 Catarina G Belém , Preethi Seshadri , Yasaman Razeghi , Sameer Singh

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found…

Computation and Language · Computer Science 2018-06-19 Adam Sutton , Thomas Lansdall-Welfare , Nello Cristianini

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

Computation and Language · Computer Science 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

Dataset bias is a significant problem in training fair classifiers. When attributes unrelated to classification exhibit strong biases towards certain classes, classifiers trained on such dataset may overfit to these bias attributes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zaiying Zhao , Soichiro Kumano , Toshihiko Yamasaki

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

Computation and Language · Computer Science 2023-06-28 Sophie Jentzsch , Cigdem Turan

The increasingly large size of modern pretrained language models not only makes them inherit more human-like biases from the training corpora, but also makes it computationally expensive to mitigate such biases. In this paper, we…

Computation and Language · Computer Science 2023-06-08 Zhongbin Xie , Thomas Lukasiewicz

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although such…

Computation and Language · Computer Science 2023-11-07 Ewoenam Kwaku Tokpo , Toon Calders

Social bias in language models can potentially exacerbate social inequalities. Despite it having garnered wide attention, most research focuses on English data. In a low-resource scenario, the models often perform worse due to insufficient…

Computation and Language · Computer Science 2025-07-15 Ej Zhou , Weiming Lu

Model-based evaluation metrics (e.g., CLIPScore and GPTScore) have demonstrated decent correlations with human judgments in various language generation tasks. However, their impact on fairness remains largely unexplored. It is widely…

Computation and Language · Computer Science 2023-11-06 Haoyi Qiu , Zi-Yi Dou , Tianlu Wang , Asli Celikyilmaz , Nanyun Peng

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza