English
Related papers

Related papers: Dikaios: Privacy Auditing of Algorithmic Fairness …

200 papers

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

Machine learning models can leak information regarding the dataset they have trained. In this paper, we present the first membership inference attack against black-boxed object detection models that determines whether the given data records…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Yeachan Park , Myungjoo Kang

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Machine learning algorithms are increasingly deployed in critical domains such as finance, healthcare, and criminal justice [1]. The increasing popularity of algorithmic decision-making has stimulated interest in algorithmic fairness within…

Machine Learning · Computer Science 2025-11-18 Animesh Joshi

The advances in Artificial Intelligence are creating new opportunities to improve lives of people around the world, from business to healthcare, from lifestyle to education. For example, some systems profile the users using their…

Machine Learning · Computer Science 2023-01-02 Arkadipta De , Satya Swaroop Gudipudi , Sourab Panchanan , Maunendra Sankar Desarkar

Explainable Artificial Intelligence (XAI) aims to uncover the decision-making processes of AI models. However, the data used for such explanations can pose security and privacy risks. Existing literature identifies attacks on machine…

Machine Learning · Computer Science 2024-07-10 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

Membership inference attacks seek to infer the membership of individual training instances of a privately trained model. This paper presents a membership privacy analysis and evaluation system, called MPLens, with three unique…

Cryptography and Security · Computer Science 2019-11-25 Stacey Truex , Ling Liu , Mehmet Emre Gursoy , Wenqi Wei , Lei Yu

Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data bias, particularly…

Machine Learning · Computer Science 2023-12-21 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

Machine learning (ML) models have the potential to transform military battlefields, presenting a large external pressure to rapidly incorporate them into operational settings. However, it is well-established that these ML models are…

Cryptography and Security · Computer Science 2025-09-05 Tyler Shumaker , Jessica Carpenter , David Saranchak , Nathaniel D. Bastian

While Membership Inference Attacks (MIAs) are the prevailing method for identifying training data, their application has expanded into privacy auditing and machine unlearning. Nevertheless, the field lacks a systematic framework for…

Machine Learning · Computer Science 2026-05-29 Ding Chen , Xinwen Cheng , Xuyang Zhong , Xinping Chen , Xiaolin Huang , Chen Liu

Fairness monitoring is critical for detecting algorithmic bias, as mandated by the EU AI Act. Since such monitoring requires sensitive user data (e.g., ethnicity), the AI Act permits its processing only with strict privacy measures, such as…

Human-Computer Interaction · Computer Science 2026-02-03 Changyang He , Parnian Jahangirirad , Lin Kyi , Asia J. Biega

With the European Union's Artificial Intelligence Act taking effect on 1 August 2024, high-risk AI applications must adhere to stringent transparency and fairness standards. This paper addresses a crucial question: how can we scientifically…

Applications · Statistics 2024-09-09 Shiqi Fang , Zexun Chen , Jake Ansell

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

The widespread use of Artificial Intelligence (AI) in consequential domains, such as healthcare and parole decision-making systems, has drawn intense scrutiny on the fairness of these methods. However, ensuring fairness is often…

Artificial Intelligence · Computer Science 2021-09-10 Ninareh Mehrabi , Umang Gupta , Fred Morstatter , Greg Ver Steeg , Aram Galstyan

In the past few years, Artificial Intelligence (AI) has garnered attention from various industries including financial services (FS). AI has made a positive impact in financial services by enhancing productivity and improving risk…

The reason behind the unfair outcomes of AI is often rooted in biased datasets. Therefore, this work presents a framework for addressing fairness by debiasing datasets containing a (non-)binary protected attribute. The framework proposes a…

Machine Learning · Computer Science 2024-11-19 Manh Khoi Duong , Stefan Conrad

Machine learning is increasingly becoming a powerful tool to make decisions in a wide variety of applications, such as medical diagnosis and autonomous driving. Privacy concerns related to the training data and unfair behaviors of some…

Cryptography and Security · Computer Science 2020-03-16 Jiahao Ding , Xinyue Zhang , Xiaohuan Li , Junyi Wang , Rong Yu , Miao Pan

Fairness in artificial intelligence (AI) prediction models is increasingly emphasized to support responsible adoption in high-stakes domains such as health care and criminal justice. Guidelines and implementation frameworks highlight the…

Machine Learning · Computer Science 2025-04-14 Yilin Ning , Yian Ma , Mingxuan Liu , Xin Li , Nan Liu

Group fairness metrics can detect when a deep learning model behaves differently for advantaged and disadvantaged groups, but even models that score well on these metrics can make blatantly unfair predictions. We present smooth prediction…

Machine Learning · Computer Science 2020-12-02 Ivoline C. Ngong , Krystal Maughan , Joseph P. Near