English
Related papers

Related papers: Differentially Private Fair Binary Classifications

200 papers

With the increased use of machine learning systems for decision making, questions about the fairness properties of such systems start to take center stage. Most existing work on algorithmic fairness assume complete observation of features…

Machine Learning · Computer Science 2022-12-06 Nikil Roashan Selvam , Guy Van den Broeck , YooJung Choi

We consider the problem of property testing for differential privacy: with black-box access to a purportedly private algorithm, can we verify its privacy guarantees? In particular, we show that any privacy guarantee that can be efficiently…

Cryptography and Security · Computer Science 2019-02-14 Anna Gilbert , Audra McMillan

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

Recent works have shown that selecting an optimal model architecture suited to the differential privacy setting is necessary to achieve the best possible utility for a given privacy budget using differentially private stochastic gradient…

Machine Learning · Computer Science 2024-11-01 Anderson Santana de Oliveira , Caelin Kaplan , Khawla Mallat , Tanmay Chakraborty

Consider a binary decision making process where a single machine learning classifier replaces a multitude of humans. We raise questions about the resulting loss of diversity in the decision making process. We study the potential benefits of…

Machine Learning · Statistics 2017-07-03 Nina Grgić-Hlača , Muhammad Bilal Zafar , Krishna P. Gummadi , Adrian Weller

In machine learning, classification models need to be trained in order to predict class labels. When the training data contains personal information about individuals, collecting training data becomes difficult due to privacy concerns.…

Machine Learning · Computer Science 2019-05-06 Emre Yilmaz , Mohammad Al-Rubaie , J. Morris Chang

In this paper, we initiate the systematic study of solving linear programs under differential privacy. The first step is simply to define the problem: to this end, we introduce several natural classes of private linear programs that capture…

Data Structures and Algorithms · Computer Science 2018-03-16 Justin Hsu , Aaron Roth , Tim Roughgarden , Jonathan Ullman

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

We show that deep networks trained to satisfy demographic parity often do so through a form of race or gender awareness, and that the more we force a network to be fair, the more accurately we can recover race or gender from the internal…

Machine Learning · Computer Science 2022-11-22 Michael Lohaus , Matthäus Kleindessner , Krishnaram Kenthapadi , Francesco Locatello , Chris Russell

Artificial Intelligence (AI) has attracted a great deal of attention in recent years. However, alongside all its advancements, problems have also emerged, such as privacy violations, security issues and model fairness. Differential privacy,…

Cryptography and Security · Computer Science 2020-09-01 Tianqing Zhu , Dayong Ye , Wei Wang , Wanlei Zhou , Philip S. Yu

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

We propose a general learning framework for the protection mechanisms that protects privacy via distorting model parameters, which facilitates the trade-off between privacy and utility. The algorithm is applicable to arbitrary privacy…

Machine Learning · Computer Science 2023-06-06 Xiaojin Zhang , Wenjie Li , Kai Chen , Shutao Xia , Qiang Yang

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Machine Learning · Statistics 2018-09-06 Niki Kilbertus , Adrià Gascón , Matt J. Kusner , Michael Veale , Krishna P. Gummadi , Adrian Weller

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Binary classification based on predicted probabilities (scores) is a fundamental task in supervised machine learning. While thresholding scores is Bayes-optimal in the unconstrained setting, using a single threshold generally violates…

Machine Learning · Computer Science 2026-02-10 Etam Benger , Katrina Ligett

We present a framework for designing differentially private (DP) mechanisms for binary functions via a graph representation of datasets. Datasets are nodes in the graph and any two neighboring datasets are connected by an edge. The true…

Information Theory · Computer Science 2021-02-11 Rafael G. L. D'Oliveira , Muriel Medard , Parastoo Sadeghi

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

This paper presents a framework for privacy-preserving verification of machine learning models, focusing on models trained on sensitive data. Integrating Local Differential Privacy (LDP) with model explanations from LIME and SHAP, our…

Machine Learning · Computer Science 2025-01-15 Wenbiao Li , Anisa Halimi , Xiaoqian Jiang , Jaideep Vaidya , Erman Ayday

Differential privacy is becoming one gold standard for protecting the privacy of publicly shared data. It has been widely used in social science, data science, public health, information technology, and the U.S. decennial census.…

Cryptography and Security · Computer Science 2022-06-07 Xuan Bi , Xiaotong Shen