English
Related papers

Related papers: InterFair: Debiasing with Natural Language Feedbac…

200 papers

Numerous debiasing techniques have been proposed to mitigate the gender bias that is prevalent in pretrained language models. These are often evaluated on datasets that check the extent to which the model is gender-neutral in its…

Computation and Language · Computer Science 2023-10-24 Mahdi Zakizadeh , Kaveh Eskandari Miandoab , Mohammad Taher Pilehvar

In many machine learning applications, there are multiple decision-makers involved, both automated and human. The interaction between these agents often goes unaddressed in algorithmic development. In this work, we explore a simple version…

Machine Learning · Statistics 2018-09-10 David Madras , Toniann Pitassi , Richard Zemel

Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural…

Common studies of gender bias in NLP focus either on extrinsic bias measured by model performance on a downstream task or on intrinsic bias found in models' internal representations. However, the relationship between extrinsic and intrinsic…

Computation and Language · Computer Science 2022-05-18 Hadas Orgad , Seraphina Goldfarb-Tarrant , Yonatan Belinkov

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

Machine Learning · Computer Science 2025-03-25 Jiali Cheng , Hadi Amiri

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

Word embeddings learnt from massive text collections have demonstrated significant levels of discriminative biases such as gender, racial or ethnic biases, which in turn bias the down-stream NLP applications that use those word embeddings.…

Computation and Language · Computer Science 2019-06-04 Masahiro Kaneko , Danushka Bollegala

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

Computation and Language · Computer Science 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal

Protecting privacy in contemporary NLP models is gaining in importance. So does the need to mitigate social biases of such models. But can we have both at the same time? Existing research suggests that privacy preservation comes at the…

Computation and Language · Computer Science 2023-05-25 Cleo Matzken , Steffen Eger , Ivan Habernal

Pretrained text encoders, such as BERT, have been applied increasingly in various natural language processing (NLP) tasks, and have recently demonstrated significant performance gains. However, recent studies have demonstrated the existence…

Computation and Language · Computer Science 2021-03-12 Pengyu Cheng , Weituo Hao , Siyang Yuan , Shijing Si , Lawrence Carin

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and…

Computation and Language · Computer Science 2022-04-11 Carolin Holtermann , Anne Lauscher , Simone Paolo Ponzetto

Language Representation Models (LRMs) trained with real-world data may capture and exacerbate undesired bias and cause unfair treatment of people in various demographic groups. Several techniques have been investigated for applying…

Computation and Language · Computer Science 2023-11-14 Chloe Qinyu Zhu , Rickard Stureborg , Brandon Fain

Recommender systems are used in variety of domains affecting people's lives. This has raised concerns about possible biases and discrimination that such systems might exacerbate. There are two primary kinds of biases inherent in recommender…

Information Retrieval · Computer Science 2018-09-25 Golnoosh Farnadi , Pigi Kouki , Spencer K. Thompson , Sriram Srinivasan , Lise Getoor

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

Machine Learning · Computer Science 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha

Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can…

Machine Learning · Computer Science 2025-07-22 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from…

Computation and Language · Computer Science 2022-05-03 Joe Stacey , Yonatan Belinkov , Marek Rei

With growing awareness of societal impact of artificial intelligence, fairness has become an important aspect of machine learning algorithms. The issue is that human biases towards certain groups of population, defined by sensitive features…

Machine Learning · Computer Science 2020-11-17 Andrija Petrović , Mladen Nikolić , Sandro Radovanović , Boris Delibašić , Miloš Jovanović

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels.…

Machine Learning · Computer Science 2022-08-02 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

Deep learning models for semantics are generally evaluated using naturalistic corpora. Adversarial methods, in which models are evaluated on new examples with known semantic properties, have begun to reveal that good performance at these…

Computation and Language · Computer Science 2021-07-27 Atticus Geiger , Ignacio Cases , Lauri Karttunen , Chris Potts