English
Related papers

Related papers: DebIE: A Platform for Implicit and Explicit Debias…

200 papers

Clinical machine learning is increasingly multimodal, collected in both structured tabular formats and unstructured forms such as freetext. We propose a novel task of exploring fairness on a multimodal clinical dataset, adopting equalized…

Computation and Language · Computer Science 2021-06-11 John Chen , Ian Berlot-Attwell , Safwan Hossain , Xindi Wang , Frank Rudzicz

In comparison to the numerous debiasing methods proposed for the static non-contextualised word embeddings, the discriminative biases in contextualised embeddings have received relatively little attention. We propose a fine-tuning method…

Computation and Language · Computer Science 2021-01-26 Masahiro Kaneko , Danushka Bollegala

A review of Word Embedding Models through a deconstructive approach reveals their several shortcomings and inconsistencies. These include instability of the vector representations, a distorted analogical reasoning, geometric incompatibility…

Computation and Language · Computer Science 2019-02-05 Koushik Varma Kalidindi

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

Social bias in language models can potentially exacerbate social inequalities. Despite it having garnered wide attention, most research focuses on English data. In a low-resource scenario, the models often perform worse due to insufficient…

Computation and Language · Computer Science 2025-07-15 Ej Zhou , Weiming Lu

Recent work has shown pre-trained language models capture social biases from the large amounts of text they are trained on. This has attracted attention to developing techniques that mitigate such biases. In this work, we perform an…

Computation and Language · Computer Science 2022-04-05 Nicholas Meade , Elinor Poole-Dayan , Siva Reddy

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

The integration of Large Language Models (LLMs) into various software applications raises concerns about their potential biases. Typically, those models are trained on a vast amount of data scrapped from forums, websites, social media and…

Software Engineering · Computer Science 2025-07-24 Sergio Morales , Robert Clarisó , Jordi Cabot

As the use of AI in society grows, addressing emerging biases is essential to prevent systematic discrimination. Several bias detection methods have been proposed, but, with few exceptions, these tend to ignore transparency. Instead,…

Artificial Intelligence · Computer Science 2025-11-18 Hamed Ayoobi , Nico Potyka , Anna Rapberger , Francesca Toni

Word embeddings provide an unsupervised way to understand differences in word usage between discursive communities. A number of recent papers have focused on identifying words that are used differently by two or more communities. But word…

Computation and Language · Computer Science 2023-02-14 Thyge Enggaard , August Lohse , Morten Axel Pedersen , Sune Lehmann

Social biases are encoded in word embeddings. This presents a unique opportunity to study society historically and at scale, and a unique danger when embeddings are used in downstream applications. Here, we investigate the extent to which…

Computation and Language · Computer Science 2020-04-28 Kenneth Joseph , Jonathan H. Morgan

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Slanted news coverage, also called media bias, can heavily influence how news consumers interpret and react to the news. To automatically identify biased language, we present an exploratory approach that compares the context of related…

Computation and Language · Computer Science 2021-12-15 Timo Spinde , Lada Rudnitckaia , Felix Hamborg , Bela Gipp

Large language models(LLM) are pre-trained on extensive corpora to learn facts and human cognition which contain human preferences. However, this process can inadvertently lead to these models acquiring biases and stereotypes prevalent in…

Computation and Language · Computer Science 2024-03-22 Yuchen Cai , Ding Cao , Rongxi Guo , Yaqin Wen , Guiquan Liu , Enhong Chen

Modern models for common NLP tasks often employ machine learning techniques and train on journalistic, social media, or other culturally-derived text. These have recently been scrutinized for racial and gender biases, rooting from inherent…

Computation and Language · Computer Science 2026-01-27 Scott Friedman , Sonja Schmer-Galunder , Anthony Chen , Jeffrey Rye

(Bolukbasi et al., 2016) demonstrated that pretrained word embeddings can inherit gender bias from the data they were trained on. We investigate how this bias affects downstream classification tasks, using the case study of occupation…

Machine Learning · Computer Science 2019-08-09 Flavien Prost , Nithum Thain , Tolga Bolukbasi

Recently, more and more research has focused on addressing bias in text classification models. However, existing research mainly focuses on the fairness of monolingual text classification models, and research on fairness for multilingual…

Computation and Language · Computer Science 2023-03-29 Nankai Lin , Junheng He , Zhenghang Tang , Dong Zhou , Aimin Yang

Social bias in language - towards genders, ethnicities, ages, and other social groups - poses a problem with ethical impact for many NLP applications. Recent research has shown that machine learning models trained on respective data may not…

Computation and Language · Computer Science 2020-11-25 Maximilian Spliethöver , Henning Wachsmuth

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou