English
Related papers

Related papers: Do Not Harm Protected Groups in Debiasing Language…

200 papers

Word embedding, which converts words into numerical values, is an important natural language processing technique and widely used. One of the serious problems of word embedding is that the bias will be learned and affect the model if the…

Human-Computer Interaction · Computer Science 2025-06-04 Arisa Sugino , Takayuki Itoh

Recent studies show that Natural Language Processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. To create interventions and mitigate these biases…

Computation and Language · Computer Science 2022-10-17 Sunipa Dev , Emily Sheng , Jieyu Zhao , Aubrie Amstutz , Jiao Sun , Yu Hou , Mattie Sanseverino , Jiin Kim , Akihiro Nishi , Nanyun Peng , Kai-Wei Chang

The advancement of Large Language Models (LLMs) has transformed Natural Language Processing (NLP), enabling performance across diverse tasks with little task-specific training. However, LLMs remain susceptible to social biases, particularly…

Computation and Language · Computer Science 2025-07-08 Melanie Galea , Claudia Borg

Representation bias is one of the most common types of biases in artificial intelligence (AI) systems, causing AI models to perform poorly on underrepresented data segments. Although AI practitioners use various methods to reduce…

Human-Computer Interaction · Computer Science 2025-02-28 Aditya Bhattacharya , Simone Stumpf , Robin De Croon , Katrien Verbert

The training of large language models (LLMs) on extensive, unfiltered corpora sourced from the internet is a common and advantageous practice. Consequently, LLMs have learned and inadvertently reproduced various types of biases, including…

Computation and Language · Computer Science 2023-11-20 Ambri Ma , Arnav Kumar , Brett Zeligson

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels.…

Machine Learning · Computer Science 2022-08-02 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

We propose selective debiasing -- an inference-time safety mechanism designed to enhance the overall model quality in terms of prediction performance and fairness, especially in scenarios where retraining the model is impractical. The…

Computation and Language · Computer Science 2025-03-12 Gleb Kuzmin , Neemesh Yadav , Ivan Smirnov , Timothy Baldwin , Artem Shelmanov

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

Computation and Language · Computer Science 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based…

Computation and Language · Computer Science 2024-08-21 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Jing Pan , Chen Jue , Zhijun Fang , Yinghui Xu , Wei Chu , Yuan Qi

Word embeddings are the standard model for semantic and syntactic representations of words. Unfortunately, these models have been shown to exhibit undesirable word associations resulting from gender, racial, and religious biases. Existing…

Computation and Language · Computer Science 2020-06-04 Vaibhav Kumar , Tenzin Singhay Bhotia , Vaibhav Kumar , Tanmoy Chakraborty

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. VLMs are being…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Walter Gerych , Haoran Zhang , Kimia Hamidieh , Eileen Pan , Maanas Sharma , Thomas Hartvigsen , Marzyeh Ghassemi

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

As Vision Language Models (VLMs) gain widespread use, their fairness remains under-explored. In this paper, we analyze demographic biases across five models and six datasets. We find that portrait datasets like UTKFace and CelebA are the…

Computation and Language · Computer Science 2025-04-01 Kuleen Sasse , Shan Chen , Jackson Pond , Danielle Bitterman , John Osborne

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a…

Computation and Language · Computer Science 2025-01-08 Aishik Rakshit , Smriti Singh , Shuvam Keshari , Arijit Ghosh Chowdhury , Vinija Jain , Aman Chadha

Bias in image restoration algorithms can hamper further analysis, typically when the intensities have a physical meaning of interest, e.g., in medical imaging. We propose to suppress a part of the bias -- the method bias -- while leaving…

Statistics Theory · Mathematics 2016-08-08 Charles-Alban Deledalle , Nicolas Papadakis , Joseph Salmon

Biases in culture, gender, ethnicity, etc. have existed for decades and have affected many areas of human social interaction. These biases have been shown to impact machine learning (ML) models, and for natural language processing (NLP),…

Computation and Language · Computer Science 2022-09-21 Dhanasekar Sundararaman , Vivek Subramanian

In the social sciences, it is often necessary to debias studies and surveys before valid conclusions can be drawn. Debiasing algorithms enable the computational removal of bias using sample weights. However, an issue arises when only a…

Machine Learning · Computer Science 2026-03-03 Tony Hauptmann , Stefan Kramer