English
Related papers

Related papers: Can Querying for Bias Leak Protected Attributes? A…

200 papers

Addressing fairness concerns about machine learning models is a crucial step towards their long-term adoption in real-world automated systems. While many approaches have been developed for training fair models from data, little is known…

Machine Learning · Computer Science 2022-06-09 Nikola Konstantinov , Christoph H. Lampert

Strategic classification, where individuals modify their features to influence machine learning (ML) decisions, presents critical fairness challenges. While group fairness in this setting has been widely studied, individual fairness remains…

Machine Learning · Computer Science 2026-02-06 Zhiqun Zuo , Mohammad Mahdi Khalili

Traditional approaches to ensure group fairness in algorithmic decision making aim to equalize ``total'' error rates for different subgroups in the population. In contrast, we argue that the fairness approaches should instead focus only on…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Preethi Lahoti , Krishna P. Gummadi

As learning-to-rank models are increasingly deployed for decision-making in areas with profound life implications, the FairML community has been developing fair learning-to-rank (LTR) models. These models rely on the availability of…

Machine Learning · Computer Science 2024-07-25 Oluseun Olulana , Kathleen Cachel , Fabricio Murai , Elke Rundensteiner

Machine learning models often preserve biases present in training data, leading to unfair treatment of certain minority groups. Despite an array of existing firm-side bias mitigation techniques, they typically incur utility costs and…

Machine Learning · Computer Science 2025-11-17 Omri Ben-Dov , Samira Samadi , Amartya Sanyal , Alexandru Ţifrea

Arbitrary, inconsistent, or faulty decision-making raises serious concerns, and preventing unfair models is an increasingly important challenge in Machine Learning. Data often reflect past discriminatory behavior, and models trained on such…

Machine Learning · Computer Science 2023-06-29 I. Oliveira e Silva , C. Soares , I. Sousa , R. Ghani

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

We propose a fairness-aware learning framework that mitigates intersectional subgroup bias associated with protected attributes. Prior research has primarily focused on mitigating one kind of bias by incorporating complex fairness-driven…

Machine Learning · Computer Science 2022-12-27 Narine Kokhlikyan , Bilal Alsallakh , Fulton Wang , Vivek Miglani , Oliver Aobo Yang , David Adkins

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

Cryptography and Security · Computer Science 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

Cryptography and Security · Computer Science 2022-09-07 Bargav Jayaraman , David Evans

Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a…

Machine Learning · Computer Science 2022-04-12 Mingyang Wan , Daochen Zha , Ninghao Liu , Na Zou

In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Ching-Hao Chiu , Yu-Jen Chen , Yawen Wu , Yiyu Shi , Tsung-Yi Ho

Bias in computer vision systems can perpetuate or even amplify discrimination against certain populations. Considering that bias is often introduced by biased visual datasets, many recent research efforts focus on training fair models using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou

When developing models for regulated decision making, sensitive features like age, race and gender cannot be used and must be obscured from model developers to prevent bias. However, the remaining features still need to be tested for…

Machine Learning · Computer Science 2020-10-13 Leo de Castro , Jiahao Chen , Antigoni Polychroniadou

In this article, we study the fundamental limits in the design of fair and/or private representations achieving perfect demographic parity and/or perfect privacy through the lens of information theory. More precisely, given some useful data…

Information Theory · Computer Science 2024-08-26 Amirreza Zamani , Borja Rodríguez-Gálvez , Mikael Skoglund

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

Artificial Intelligence · Computer Science 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for…

Machine Learning · Computer Science 2023-08-02 Héber H. Arcolezi , Karima Makhlouf , Catuscia Palamidessi

The possible risk that AI systems could promote discrimination by reproducing and enforcing unwanted bias in data has been broadly discussed in research and society. Many current legal standards demand to remove sensitive attributes from…

Artificial Intelligence · Computer Science 2020-09-15 Boris Ruf , Marcin Detyniecki