English
Related papers

Related papers: Benchmarking Bias Mitigation Toward Fairness Witho…

200 papers

Algorithmic bias mitigation has been one of the most difficult conundrums for the data science community and Machine Learning (ML) experts. Over several years, there have appeared enormous efforts in the field of fairness in ML. Despite the…

Large Language Models (LLMs) are prone to inheriting and amplifying societal biases embedded within their training data, potentially reinforcing harmful stereotypes related to gender, occupation, and other sensitive categories. This issue…

Computation and Language · Computer Science 2024-08-28 Atmika Gorti , Manas Gaur , Aman Chadha

The rapid adoption of large language models (LLMs) in recommender systems (RS) presents new challenges in understanding and evaluating their biases, which can result in unfairness or the amplification of stereotypes. Traditional fairness…

Information Retrieval · Computer Science 2024-09-12 Yashar Deldjoo , Fatemeh Nazary

Machine Learning (ML) systems are increasingly used to support decision-making processes that affect individuals. However, these systems often rely on biased data, which can lead to unfair outcomes against specific groups. With the growing…

Machine Learning · Computer Science 2026-04-14 Joana Simões , João Correia

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague…

Computation and Language · Computer Science 2023-02-14 Xudong Han , Timothy Baldwin , Trevor Cohn

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

Recent advances in generative models have sparked research on improving model fairness with AI-generated data. However, existing methods often face limitations in the diversity and quality of synthetic data, leading to compromised fairness…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zengqun Zhao , Ziquan Liu , Yu Cao , Shaogang Gong , Ioannis Patras

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen

Despite a surge of recent advances in promoting machine Learning (ML) fairness, the existing mainstream approaches mostly require retraining or finetuning the entire weights of the neural network to meet the fairness criteria. However, this…

Machine Learning · Computer Science 2022-12-13 Guanhua Zhang , Yihua Zhang , Yang Zhang , Wenqi Fan , Qing Li , Sijia Liu , Shiyu Chang

Conventional large language model (LLM) fairness alignment largely focuses on mitigating bias along single sensitive attributes, overlooking fairness as an inherently multidimensional and context-specific value. This approach risks creating…

Machine Learning · Computer Science 2026-02-19 Eva Paraschou , Line Harder Clemmensen , Sneha Das

The emergence of Large Vision-Language Models (LVLMs) marks significant strides towards achieving general artificial intelligence. However, these advancements are accompanied by concerns about biased outputs, a challenge that has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sibo Wang , Xiangkui Cao , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen , Wen Gao

LLMs have demonstrated remarkable performance across diverse applications, yet they inadvertently absorb spurious correlations from training data, leading to stereotype associations between biased concepts and specific social groups. These…

Software Engineering · Computer Science 2025-04-11 Yisong Xiao , Aishan Liu , Siyuan Liang , Xianglong Liu , Dacheng Tao

The rise of general-purpose artificial intelligence (AI) systems, particularly large language models (LLMs), has raised pressing moral questions about how to reduce bias and ensure fairness at scale. Researchers have documented a sort of…

Computation and Language · Computer Science 2025-06-06 Jacy Anthis , Kristian Lum , Michael Ekstrand , Avi Feller , Chenhao Tan

In recent years, the affective computing (AC) and human-robot interaction (HRI) research communities have put fairness at the centre of their research agenda. However, none of the existing work has addressed the problem of machine learning…

Robotics · Computer Science 2024-07-03 Jiaee Cheong , Micol Spitale , Hatice Gunes

Context: Machine learning software can generate models that inappropriately discriminate against specific protected social groups (e.g., groups based on gender, ethnicity, etc). Motivated by those results, software engineering researchers…

Machine Learning · Computer Science 2022-10-31 Kewen Peng , Joymallya Chakraborty , Tim Menzies

While the need for well-trained, fair ML systems is increasing ever more, measuring fairness for modern models and datasets is becoming increasingly difficult as they grow at an unprecedented pace. One key challenge in scaling common…

Artificial Intelligence · Computer Science 2022-01-19 Alex Bäuerle , Aybuke Gul Turker , Ken Burke , Osman Aka , Timo Ropinski , Christina Greer , Mani Varadarajan

Motivated by concerns surrounding the fairness effects of sharing and transferring fair machine learning tools, we propose two algorithms: Fairness Warnings and Fair-MAML. The first is a model-agnostic algorithm that provides interpretable…

Machine Learning · Computer Science 2019-12-06 Dylan Slack , Sorelle Friedler , Emile Givental