English
Related papers

Related papers: BiasGuard: Guardrailing Fairness in Machine Learni…

200 papers

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

Algorithmic fairness, the research field of making machine learning (ML) algorithms fair, is an established area in ML. As ML technologies expand their application domains, including ones with high societal impact, it becomes essential to…

Machine Learning · Computer Science 2023-12-12 Wenbin Zhang , Zichong Wang , Juyong Kim , Cheng Cheng , Thomas Oommen , Pradeep Ravikumar , Jeremy Weiss

Fairness in machine learning (ML) has become a rapidly growing area of research. But why, in the first place, is unfairness in ML wrong? And why should we care about improving fairness? Most fair-ML research implicitly appeals to…

Machine Learning · Computer Science 2026-02-27 Youjin Kong

Machine learning is a tool for building models that accurately represent input training data. When undesired biases concerning demographic groups are in the training data, well-trained models will reflect those biases. We present a…

Machine Learning · Computer Science 2018-01-25 Brian Hu Zhang , Blake Lemoine , Margaret Mitchell

Fairness-aware learning is increasingly important in data mining. Discrimination prevention aims to prevent discrimination in the training data before it is used to conduct predictive analysis. In this paper, we focus on fair data…

Machine Learning · Computer Science 2018-05-30 Depeng Xu , Shuhan Yuan , Lu Zhang , Xintao Wu

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and…

Human-Computer Interaction · Computer Science 2019-01-09 Kenneth Holstein , Jennifer Wortman Vaughan , Hal Daumé , Miro Dudík , Hanna Wallach

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

Generative adversarial networks (GANs) are one of the greatest advances in AI in recent years. With their ability to directly learn the probability distribution of data, and then sample synthetic realistic data. Many applications have…

Recent advances in generative models have sparked research on improving model fairness with AI-generated data. However, existing methods often face limitations in the diversity and quality of synthetic data, leading to compromised fairness…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zengqun Zhao , Ziquan Liu , Yu Cao , Shaogang Gong , Ioannis Patras

Ensuring fairness has emerged as one of the primary concerns in AI and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field…

Machine Learning · Computer Science 2024-11-15 Quan Zhou

Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of…

Machine Learning · Computer Science 2022-05-06 Avijit Ghosh , Lea Genuit , Mary Reagan

The fairness of machine learning (ML) approaches is critical to the reliability of modern artificial intelligence systems. Despite extensive study on this topic, the fairness of ML models in the software engineering (SE) domain has not been…

Software Engineering · Computer Science 2023-07-24 Mohammad Mahdi Mohajer , Alvine Boaye Belle , Nima Shiri harzevili , Junjie Wang , Hadi Hemmati , Song Wang , Zhen Ming , Jiang

Recently, there has been a rising awareness that when machine learning (ML) algorithms are used to automate choices, they may treat/affect individuals unfairly, with legal, ethical, or economic consequences. Recommender systems are…

Information Retrieval · Computer Science 2022-04-19 Mohammadmehdi Naghiaei , Hossein A. Rahmani , Yashar Deldjoo

Predictive models often reinforce biases which were originally embedded in their training data, through skewed decisions. In such cases, mitigation methods are critical to ensure that, regardless of the prevailing disparities, model…

Machine Learning · Statistics 2025-07-15 Ricardo Inácio , Zafeiris Kokkinogenis , Vitor Cerqueira , Carlos Soares

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

AI models have become active decision makers, often acting without human supervision. The rapid advancement of AI technology has already caused harmful incidents that have hurt individuals and societies and AI unfairness in heavily…

Computers and Society · Computer Science 2025-06-12 Athena Vakali , Ilias Dimitriadis

Machine learning (ML) may be oblivious to human bias but it is not immune to its perpetuation. Marginalisation and iniquitous group representation are often traceable in the very data used for training, and may be reflected or even enhanced…

Machine Learning · Computer Science 2024-12-02 Stefano Sarao Mannelli , Federica Gerace , Negar Rostamzadeh , Luca Saglietti

Fairness has become an essential problem in many domains of Machine Learning (ML), such as classification, natural language processing, and Generative Adversarial Networks (GANs). In this research effort, we study the unfairness of GANs. We…

Machine Learning · Computer Science 2022-07-22 Patrik Joslin Kenfack , Kamil Sabbagh , Adín Ramírez Rivera , Adil Khan

Machine learning models trained on real-world data may inadvertently make biased predictions that negatively impact marginalized communities. Reweighting, which assigns a weight to each data point used during model training, can mitigate…

Machine Learning · Computer Science 2026-03-20 Anil K. Saini , Jose Guadalupe Hernandez , Emily F. Wong , Debanshi Misra , Tiffani J. Bright , Jason H. Moore