English
Related papers

Related papers: Evaluating Debiasing Techniques for Intersectional…

200 papers

Statistical fairness stipulates equivalent outcomes for every protected group, whereas causal fairness prescribes that a model makes the same prediction for an individual regardless of their protected characteristics. Counterfactual data…

Computation and Language · Computer Science 2024-04-02 Hannah Chen , Yangfeng Ji , David Evans

Language models are the new state-of-the-art natural language processing (NLP) models and they are being increasingly used in many NLP tasks. Even though there is evidence that language models are biased, the impact of that bias on the…

Computation and Language · Computer Science 2024-04-29 Fatma Elsafoury , Stamos Katsigiannis

NLU models often exploit biases to achieve high dataset-specific performance without properly learning the intended task. Recently proposed debiasing methods are shown to be effective in mitigating this tendency. However, these methods rely…

Computation and Language · Computer Science 2020-10-14 Prasetya Ajie Utama , Nafise Sadat Moosavi , Iryna Gurevych

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and…

Computation and Language · Computer Science 2022-04-11 Carolin Holtermann , Anne Lauscher , Simone Paolo Ponzetto

An indigenous perspective on the effectiveness of debiasing techniques for pre-trained language models (PLMs) is presented in this paper. The current techniques used to measure and debias PLMs are skewed towards the US racial biases and…

Computation and Language · Computer Science 2023-04-24 Vithya Yogarajan , Gillian Dobbie , Henry Gouk

Most works on gender bias focus on intrinsic bias -- removing traces of information about a protected group from the model's internal representation. However, these works are often disconnected from the impact of such debiasing on…

Computation and Language · Computer Science 2024-06-04 Bar Iluz , Yanai Elazar , Asaf Yehudai , Gabriel Stanovsky

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

Computation and Language · Computer Science 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

Gender bias in language models has attracted sufficient attention because it threatens social justice. However, most of the current debiasing methods degraded the model's performance on other tasks while the degradation mechanism is still…

Computation and Language · Computer Science 2023-06-13 Yiran Liu , Xiao Liu , Haotian Chen , Yang Yu

Despite remarkable success in diverse web-based applications, Graph Neural Networks(GNNs) inherit and further exacerbate historical discrimination and social stereotypes, which critically hinder their deployments in high-stake domains such…

Machine Learning · Computer Science 2025-01-28 Ying Song , Balaji Palanisamy

Online texts -- across genres, registers, domains, and styles -- are riddled with human stereotypes, expressed in overt or subtle ways. Word embeddings, trained on these texts, perpetuate and amplify these stereotypes, and propagate biases…

Computation and Language · Computer Science 2019-07-03 Thomas Manzini , Yao Chong Lim , Yulia Tsvetkov , Alan W Black

Existing NLP datasets contain various biases that models can easily exploit to achieve high performances on the corresponding evaluation sets. However, focusing on dataset-specific biases limits their ability to learn more generalizable…

Computation and Language · Computer Science 2020-10-08 Mingzhu Wu , Nafise Sadat Moosavi , Andreas Rücklé , Iryna Gurevych

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Cross-lingual natural language processing relies on translation, either by humans or machines, at different levels, from translating training data to translating test sets. However, compared to original texts in the same language,…

Computation and Language · Computer Science 2022-05-18 Koel Dutta Chowdhury , Rricha Jalota , Cristina España-Bonet , Josef van Genabith

Recent work has shown pre-trained language models capture social biases from the large amounts of text they are trained on. This has attracted attention to developing techniques that mitigate such biases. In this work, we perform an…

Computation and Language · Computer Science 2022-04-05 Nicholas Meade , Elinor Poole-Dayan , Siva Reddy

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

Computation and Language · Computer Science 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

Recent breakthroughs in self supervised training have led to a new class of pretrained vision language models. While there have been investigations of bias in multimodal models, they have mostly focused on gender and racial bias, giving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Sepehr Janghorbani , Gerard de Melo

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

Computation and Language · Computer Science 2023-11-28 Ananya Malik