English
Related papers

Related papers: A Comprehensive Empirical Study of Bias Mitigation…

200 papers

The widespread deployment of Large Language Models (LLMs) has intensified concerns about subtle social biases embedded in their outputs. Existing guardrails often fail when faced with indirect or contextually complex bias-inducing prompts.…

Software Engineering · Computer Science 2025-12-02 Sina Salimian , Gias Uddin , Sumon Biswas , Henry Leung

In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair…

Machine Learning · Computer Science 2023-12-12 Mohit Sharma , Amit Deshpande , Rajiv Ratn Shah

Large Language Models (LLMs) have made significant strides in the field of artificial intelligence, showcasing their ability to interact with humans and influence human cognition through information dissemination. However, recent studies…

Computation and Language · Computer Science 2024-11-25 Qingquan Zhang , Qiqi Duan , Bo Yuan , Yuhui Shi , Jialin Liu

When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory…

Machine Learning · Computer Science 2024-12-10 Jan Pablo Burgard , João Vitor Pamplona

Machine learning is widely used to make decisions with societal impact such as bank loan approving, criminal sentencing, and resume filtering. How to ensure its fairness while maintaining utility is a challenging but crucial issue. Fairness…

Machine Learning · Computer Science 2023-08-14 Simiao Zhang , Jitao Bai , Menghong Guan , Yihao Huang , Yueling Zhang , Jun Sun , Geguang Pu

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Motivated by the growing importance of reducing unfairness in ML predictions, Fair-ML researchers have presented an extensive suite of algorithmic 'fairness-enhancing' remedies. Most existing algorithms, however, are agnostic to the sources…

Machine Learning · Computer Science 2022-12-14 Nil-Jana Akpinar , Manish Nagireddy , Logan Stapleton , Hao-Fei Cheng , Haiyi Zhu , Steven Wu , Hoda Heidari

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Recent studies highlight the effectiveness of using in-context learning (ICL) to steer large language models (LLMs) in processing tabular data, a challenging task given the structured nature of such data. Despite advancements in…

Machine Learning · Computer Science 2024-08-20 Jingyu Hu , Weiru Liu , Mengnan Du

Fair machine learning works have been focusing on the development of equitable algorithms that address discrimination of certain groups. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which…

Machine Learning · Computer Science 2021-12-14 Ana Valdivia , Javier Sánchez-Monedero , Jorge Casillas

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and…

Human-Computer Interaction · Computer Science 2019-01-09 Kenneth Holstein , Jennifer Wortman Vaughan , Hal Daumé , Miro Dudík , Hanna Wallach

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

Machine Learning · Statistics 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto

Fairness is a critical component of Trustworthy AI. In this paper, we focus on Machine Learning (ML) and the performance of model predictions when dealing with skin color. Unlike other sensitive attributes, the nature of skin color differs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Kuniko Paxton , Koorosh Aslansefat , Dhavalkumar Thakker , Yiannis Papadopoulos

Fairness--the absence of unjustified bias--is a core principle in the development of Artificial Intelligence (AI) systems, yet it remains difficult to assess and enforce. Current approaches to fairness testing in large language models…

Software Engineering · Computer Science 2026-01-13 Miguel Romero-Arjona , José A. Parejo , Juan C. Alonso , Ana B. Sánchez , Aitor Arrieta , Sergio Segura

A major problem with using automated classification systems is that if they are not engineered correctly and with fairness considerations, they could be detrimental to certain populations. Furthermore, while engineers have developed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dalia Ortiz Pablo , Sushruth Badri , Erik Norén , Christoph Nötzli

Unfair predictions of machine learning (ML) models impede their broad acceptance in real-world settings. Tackling this arduous challenge first necessitates defining what it means for an ML model to be fair. This has been addressed by the ML…

Machine Learning · Computer Science 2024-08-30 Selim Kuzucu , Jiaee Cheong , Hatice Gunes , Sinan Kalkan

Fairness emerged as an important requirement to guarantee that Machine Learning (ML) predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity…

Machine Learning · Computer Science 2022-06-08 Karima Makhlouf , Sami Zhioua , Catuscia Palamidessi

Enabling non-discrimination for end-users of recommender systems by introducing consumer fairness is a key problem, widely studied in both academia and industry. Current research has led to a variety of notions, metrics, and unfairness…

Information Retrieval · Computer Science 2022-08-24 Ludovico Boratto , Gianni Fenu , Mirko Marras , Giacomo Medda

Fairness metrics are a core tool in the fair machine learning literature (FairML), used to determine that ML models are, in some sense, "fair". Real-world data, however, are typically plagued by various measurement biases and other violated…

Machine Learning · Computer Science 2024-10-16 Jake Fawkes , Nic Fishman , Mel Andrews , Zachary C. Lipton