English
Related papers

Related papers: Automated Directed Fairness Testing

200 papers

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Although several fairness definitions and bias mitigation techniques exist in the literature, all existing solutions evaluate fairness of Machine Learning (ML) systems after the training stage. In this paper, we take the first steps towards…

Machine Learning · Computer Science 2024-01-17 Arumoy Shome , Luis Cruz , Arie van Deursen

Model fairness is becoming important in class-incremental learning for Trustworthy AI. While accuracy has been a central focus in class-incremental learning, fairness has been relatively understudied. However, naively using all the samples…

Machine Learning · Computer Science 2025-12-30 Jaeyoung Park , Minsu Kim , Steven Euijong Whang

Algorithmic fairness is often studied in static or single-agent settings, yet many real-world decision-making systems involve multiple interacting entities whose multi-stage actions jointly influence long-term outcomes. Existing fairness…

As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of…

Machine Learning · Computer Science 2022-03-08 Tai Le Quy , Arjun Roy , Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Decision making in crucial applications such as lending, hiring, and college admissions has witnessed increasing use of algorithmic models and techniques as a result of a confluence of factors such as ubiquitous connectivity, ability to…

Artificial Intelligence · Computer Science 2020-09-08 G Roshan Lal , Sahin Cem Geyik , Krishnaram Kenthapadi

Data-driven software is increasingly being used as a critical component of automated decision-support systems. Since this class of software learns its logic from historical data, it can encode or amplify discriminatory practices. Previous…

Software Engineering · Computer Science 2025-01-22 Verya Monjezi , Ashutosh Trivedi , Vladik Kreinovich , Saeid Tizpaz-Niari

The field of fair machine learning aims to ensure that decisions guided by algorithms are equitable. Over the last decade, several formal, mathematical definitions of fairness have gained prominence. Here we first assemble and categorize…

Computers and Society · Computer Science 2023-08-31 Sam Corbett-Davies , Johann D. Gaebler , Hamed Nilforoshan , Ravi Shroff , Sharad Goel

Aequitas Flow is an open-source framework and toolkit for end-to-end Fair Machine Learning (ML) experimentation, and benchmarking in Python. This package fills integration gaps that exist in other fair ML packages. In addition to the…

Machine learning (ML) is increasingly being used in high-stakes applications impacting society. Therefore, it is of critical importance that ML models do not propagate discrimination. Collecting accurate labeled data in societal…

Machine Learning · Computer Science 2021-04-01 Hadis Anahideh , Abolfazl Asudeh , Saravanan Thirumuruganathan

Fairness emerged as an important requirement to guarantee that Machine Learning (ML) predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity…

Machine Learning · Computer Science 2022-06-08 Karima Makhlouf , Sami Zhioua , Catuscia Palamidessi

The most prevalent notions of fairness in machine learning are statistical definitions: they fix a small collection of pre-defined groups, and then ask for parity of some statistic of the classifier across these groups. Constraints of this…

Machine Learning · Computer Science 2018-12-04 Michael Kearns , Seth Neel , Aaron Roth , Zhiwei Steven Wu

As machine learning systems are increasingly used to make real world legal and financial decisions, it is of paramount importance that we develop algorithms to verify that these systems do not discriminate against minorities. We design a…

Artificial Intelligence · Computer Science 2020-01-01 Osbert Bastani , Xin Zhang , Armando Solar-Lezama

In recent years, a growing body of work has emerged on how to learn machine learning models under fairness constraints, often expressed with respect to some sensitive attributes. In this work, we consider the setting in which an adversary…

Machine Learning · Computer Science 2022-09-07 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Numerous fairness metrics have been proposed and employed by artificial intelligence (AI) experts to quantitatively measure bias and define fairness in AI models. Recognizing the need to accommodate stakeholders' diverse fairness…

Artificial Intelligence · Computer Science 2025-02-11 Lin Luo , Yuri Nakao , Mathieu Chollet , Hiroya Inakoshi , Simone Stumpf

Unfair predictions of machine learning (ML) models impede their broad acceptance in real-world settings. Tackling this arduous challenge first necessitates defining what it means for an ML model to be fair. This has been addressed by the ML…

Machine Learning · Computer Science 2024-08-30 Selim Kuzucu , Jiaee Cheong , Hatice Gunes , Sinan Kalkan

Large Language Models (LLMs) are being increasingly integrated into software systems, offering powerful capabilities but also raising concerns about fairness. Existing fairness benchmarks, however, focus on stereotype-specific associations,…

Software Engineering · Computer Science 2026-04-08 Gianmario Voria , Martina De Lucia , Alessandra Raia , Andrea De Lucia , Gemma Catolino , Fabio Palomba

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Algorithmic fairness involves expressing notions such as equity, or reasonable treatment, as quantifiable measures that a machine learning algorithm can optimise. Most work in the literature to date has focused on classification problems…

Machine Learning · Computer Science 2020-03-06 Daniel Steinberg , Alistair Reid , Simon O'Callaghan