English
Related papers

Related papers: Improving Bias Mitigation through Bias Experts in …

200 papers

An increased awareness concerning risks of algorithmic bias has driven a surge of efforts around bias mitigation strategies. A vast majority of the proposed approaches fall under one of two categories: (1) imposing algorithmic fairness…

Machine Learning · Computer Science 2023-07-11 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Deep learning could be prone to learning shortcuts raised by dataset bias and result in inaccurate, unreliable, and unfair models, which impedes its adoption in real-world clinical applications. Despite its significance, there is a dearth…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Luyang Luo , Xin Huang , Minghao Wang , Zhuoyue Wan , Hao Chen

Bias mitigation methods for binary classification decision-making systems have been widely researched due to the ever-growing importance of designing fair machine learning processes that are impartial and do not discriminate against…

Machine Learning · Computer Science 2023-06-01 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

Statistical natural language inference (NLI) models are susceptible to learning dataset bias: superficial cues that happen to associate with the label on a particular dataset, but are not useful in general, e.g., negation words indicate…

Computation and Language · Computer Science 2019-11-26 He He , Sheng Zha , Haohan Wang

This paper investigates the transferability of debiasing techniques across different languages within multilingual models. We examine the applicability of these techniques in English, French, German, and Dutch. Using multilingual BERT…

Computation and Language · Computer Science 2023-10-17 Manon Reusens , Philipp Borchert , Margot Mieskes , Jochen De Weerdt , Bart Baesens

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model's parameters,…

Computation and Language · Computer Science 2023-06-21 Deepak Kumar , Oleg Lesota , George Zerveas , Daniel Cohen , Carsten Eickhoff , Markus Schedl , Navid Rekabsaz

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Diffusion Models (DMs) have emerged as powerful generative models with unprecedented image generation capability. These models are widely used for data augmentation and creative applications. However, DMs reflect the biases present in the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Rishubh Parihar , Abhijnya Bhat , Abhipsa Basu , Saswat Mallick , Jogendra Nath Kundu , R. Venkatesh Babu

Generating fair and accurate predictions plays a pivotal role in deploying large language models (LLMs) in the real world. However, existing debiasing methods inevitably generate unfair or incorrect predictions as they are designed and…

Computation and Language · Computer Science 2025-02-28 Ruizhe Chen , Yichen Li , Jianfei Yang , Joey Tianyi Zhou , Jian Wu , Zuozhu Liu

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

We explore the internal mechanisms of how bias emerges in large language models (LLMs) when provided with ambiguous comparative prompts: inputs that compare or enforce choosing between two or more entities without providing clear context…

Computation and Language · Computer Science 2024-10-31 Rishabh Adiga , Besmira Nushi , Varun Chandrasekaran

Existing Natural Language Understanding (NLU) models have been shown to incorporate dataset biases leading to strong performance on in-distribution (ID) test sets but poor performance on out-of-distribution (OOD) ones. We introduce a simple…

Computation and Language · Computer Science 2021-09-07 Abbas Ghaddar , Philippe Langlais , Mehdi Rezagholizadeh , Ahmad Rashid

To mitigate societal biases implicitly encoded in recent successful pretrained language models, a diverse array of approaches have been proposed to encourage model fairness, focusing on prompting, data augmentation, regularized fine-tuning,…

Computation and Language · Computer Science 2025-01-30 Jingxuan Xu , Wuyang Chen , Linyi Li , Yao Zhao , Yunchao Wei

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

Deep learning models are prone to learning shortcut solutions to problems using spuriously correlated yet irrelevant features of their training data. In high-risk applications such as medical image analysis, this phenomenon may prevent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christopher Boland , Sotirios Tsaftaris , Sonia Dahdouh

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach…

Machine Learning · Computer Science 2016-05-30 Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , Thorsten Joachims

Learning contrastive representations from pairwise comparisons has achieved remarkable success in various fields, such as natural language processing, computer vision, and information retrieval. Collaborative filtering algorithms based on…

Information Retrieval · Computer Science 2023-08-01 Bin Liu , Qin Luo , Bang Wang

Large Language Models (LLMs) are powerful tools with the potential to benefit society immensely, yet, they have demonstrated biases that perpetuate societal inequalities. Despite significant advancements in bias mitigation techniques using…

Computation and Language · Computer Science 2024-09-24 Deonna M. Owens , Ryan A. Rossi , Sungchul Kim , Tong Yu , Franck Dernoncourt , Xiang Chen , Ruiyi Zhang , Jiuxiang Gu , Hanieh Deilamsalehy , Nedim Lipka

We tackle the problem of bias mitigation of algorithmic decisions in a setting where both the output of the algorithm and the sensitive variable are continuous. Most of prior work deals with discrete sensitive variables, meaning that the…