English
Related papers

Related papers: Can Querying for Bias Leak Protected Attributes? A…

200 papers

The reason behind the unfair outcomes of AI is often rooted in biased datasets. Therefore, this work presents a framework for addressing fairness by debiasing datasets containing a (non-)binary protected attribute. The framework proposes a…

Machine Learning · Computer Science 2024-11-19 Manh Khoi Duong , Stefan Conrad

A critical concern in data-driven processes is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the group…

Machine Learning · Computer Science 2022-04-12 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

In credit markets, screening algorithms aim to discriminate between good-type and bad-type borrowers. However, when doing so, they can also discriminate between individuals sharing a protected attribute (e.g. gender, age, racial origin) and…

Machine Learning · Statistics 2024-02-09 Christophe Hurlin , Christophe Pérignon , Sébastien Saurin

Advances in algorithmic fairness have largely omitted sexual orientation and gender identity. We explore queer concerns in privacy, censorship, language, online safety, health, and employment to study the positive and negative effects of…

Computers and Society · Computer Science 2021-04-29 Nenad Tomasev , Kevin R. McKee , Jackie Kay , Shakir Mohamed

Decision making in crucial applications such as lending, hiring, and college admissions has witnessed increasing use of algorithmic models and techniques as a result of a confluence of factors such as ubiquitous connectivity, ability to…

Artificial Intelligence · Computer Science 2020-09-08 G Roshan Lal , Sahin Cem Geyik , Krishnaram Kenthapadi

Learning a fair predictive model is crucial to mitigate biased decisions against minority groups in high-stakes applications. A common approach to learn such a model involves solving an optimization problem that maximizes the predictive…

Machine Learning · Computer Science 2023-06-08 Abhin Shah , Maohao Shen , Jongha Jon Ryu , Subhro Das , Prasanna Sattigeri , Yuheng Bu , Gregory W. Wornell

Preserving the individuals' privacy in sharing spatial-temporal datasets is critical to prevent re-identification attacks based on unique trajectories. Existing privacy techniques tend to propose ideal privacy-utility tradeoffs, however,…

Machine Learning · Computer Science 2023-04-14 Yuting Zhan , Hamed Haddadi , Afra Mashhadi

Existing research mostly improves the fairness of Machine Learning (ML) software regarding a single protected attribute at a time, but this is unrealistic given that many users have multiple protected attributes. This paper conducts an…

Machine Learning · Computer Science 2024-04-05 Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Mark Harman

To mitigate the effects of undesired biases in models, several approaches propose to pre-process the input dataset to reduce the risks of discrimination by preventing the inference of sensitive attributes. Unfortunately, most of these…

Machine Learning · Computer Science 2023-02-21 Sébastien Gambs , Rosin Claude Ngueveu

Organizations that own data face increasing legal liability for its discriminatory use against protected demographic groups, extending to contractual transactions involving third parties access and use of the data. This is problematic,…

Machine Learning · Computer Science 2020-06-17 Xavier Gitiaux , Huzefa Rangwala

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these…

Machine Learning · Statistics 2026-03-10 Yi Yang , Xiangyu Chang , Pei-yu Chen

Most existing works on fairness assume the model has full access to demographic information. However, there exist scenarios where demographic information is partially available because a record was not maintained throughout data collection…

Machine Learning · Computer Science 2024-09-19 Patrik Joslin Kenfack , Samira Ebrahimi Kahou , Ulrich Aïvodji

Algorithms deployed in education can shape the learning experience and success of a student. It is therefore important to understand whether and how such algorithms might create inequalities or amplify existing biases. In this paper, we…

Computers and Society · Computer Science 2022-12-21 Jade Maï Cock , Muhammad Bilal , Richard Davis , Mirko Marras , Tanja Käser

Machine learning models are often personalized with categorical attributes that are protected, sensitive, self-reported, or costly to acquire. In this work, we show models that are personalized with group attributes can reduce performance…

Machine Learning · Statistics 2023-07-25 Vinith M. Suriyakumar , Marzyeh Ghassemi , Berk Ustun

Organizations cannot address demographic disparities that they cannot see. Recent research on machine learning and fairness has emphasized that awareness of sensitive attributes, such as race and sex, is critical to the development of…

Computers and Society · Computer Science 2019-12-16 Miranda Bogen , Aaron Rieke , Shazeda Ahmed

AI systems have been known to amplify biases in real-world data. Explanations may help human-AI teams address these biases for fairer decision-making. Typically, explanations focus on salient input features. If a model is biased against…

Artificial Intelligence · Computer Science 2024-04-10 Navita Goyal , Connor Baumler , Tin Nguyen , Hal Daumé

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Fairness-aware classification models have gained increasing attention in recent years as concerns grow on discrimination against some demographic groups. Most existing models require full knowledge of the sensitive features, which can be…

Machine Learning · Computer Science 2025-05-02 Kaiqi Jiang , Wenzhe Fan , Mao Li , Xinhua Zhang