English
Related papers

Related papers: Model Explanations with Differential Privacy

200 papers

We propose, implement, and evaluate a new algorithm for releasing answers to very large numbers of statistical queries like $k$-way marginals, subject to differential privacy. Our algorithm makes adaptive use of a continuous relaxation of…

Machine Learning · Computer Science 2021-06-24 Sergul Aydore , William Brown , Michael Kearns , Krishnaram Kenthapadi , Luca Melis , Aaron Roth , Ankit Siva

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained…

Cryptography and Security · Computer Science 2024-04-02 Shanglun Feng , Florian Tramèr

A critical concern in data-driven decision making is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the…

Machine Learning · Computer Science 2020-09-29 Cuong Tran , Ferdinando Fioretto , Pascal Van Hentenryck

Motivation: Human genomic datasets often contain sensitive information that limits use and sharing of the data. In particular, simple anonymisation strategies fail to provide sufficient level of protection for genomic data, because the data…

Quantitative Methods · Quantitative Biology 2019-08-27 Teppo Niinimäki , Mikko Heikkilä , Antti Honkela , Samuel Kaski

The successful deployment of artificial intelligence (AI) in many domains from healthcare to hiring requires their responsible use, particularly in model explanations and privacy. Explainable artificial intelligence (XAI) provides more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xuejun Zhao , Wencan Zhang , Xiaokui Xiao , Brian Y. Lim

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Quantum machine learning (QML) promises significant computational advantages, yet models trained on sensitive data risk memorizing individual records, creating serious privacy vulnerabilities. While Quantum Differential Privacy (QDP)…

Machine Learning · Computer Science 2025-12-17 Baobao Song , Shiva Raj Pokhrel , Athanasios V. Vasilakos , Tianqing Zhu , Gang Li

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it a promising approach for privacy-preserving machine learning. However, ensuring differential privacy (DP) in FL…

Machine Learning · Computer Science 2025-03-28 Kanishka Ranaweera , David Smith , Pubudu N. Pathirana , Ming Ding , Thierry Rakotoarivelo , Aruna Seneviratne

The proliferation of deep learning applications in healthcare calls for data aggregation across various institutions, a practice often associated with significant privacy concerns. This concern intensifies in medical image analysis, where…

Machine Learning · Computer Science 2023-07-03 Kishore Babu Nampalle , Pradeep Singh , Uppala Vivek Narayan , Balasubramanian Raman

Differential privacy (DP) has a wide range of applications for protecting data privacy, but designing and verifying DP algorithms requires expert-level reasoning, creating a high barrier for non-expert practitioners. Prior works either rely…

Machine Learning · Computer Science 2026-05-19 Erchi Wang , Pengrun Huang , Eli Chien , Om Thakkar , Kamalika Chaudhuri , Yu-Xiang Wang , Ruihan Wu

Deep learning with differential privacy (DP) has garnered significant attention over the past years, leading to the development of numerous methods aimed at enhancing model accuracy and training efficiency. This paper delves into the…

Machine Learning · Computer Science 2024-08-27 Youlong Ding , Xueyang Wu , Yining Meng , Yonggang Luo , Hao Wang , Weike Pan

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

Fairness and privacy are two important values machine learning (ML) practitioners often seek to operationalize in models. Fairness aims to reduce model bias for social/demographic sub-groups. Privacy via differential privacy (DP)…

Machine Learning · Computer Science 2024-02-08 Sanjari Srivastava , Piotr Mardziel , Zhikhun Zhang , Archana Ahlawat , Anupam Datta , John C Mitchell

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

Machine Learning · Statistics 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

Recent works have shown that selecting an optimal model architecture suited to the differential privacy setting is necessary to achieve the best possible utility for a given privacy budget using differentially private stochastic gradient…

Machine Learning · Computer Science 2024-11-01 Anderson Santana de Oliveira , Caelin Kaplan , Khawla Mallat , Tanmay Chakraborty

We present new methods for assessing the privacy guarantees of an algorithm with regard to R\'enyi Differential Privacy. To the best of our knowledge, this work is the first to address this problem in a black-box scenario, where only…

Cryptography and Security · Computer Science 2022-12-12 Tim Kutta , Önder Askin , Martin Dunsche

Recently differential privacy has been used for a number of streaming, data structure, and dynamic graph problems as a means of hiding the internal randomness of the data structure, so that multiple possibly adaptive queries can be made…

Data Structures and Algorithms · Computer Science 2025-06-09 Shiyuan Feng , Ying Feng , George Z. Li , Zhao Song , David P. Woodruff , Lichen Zhang

Differential privacy is a recent notion of privacy for statistical databases that provides rigorous, meaningful confidentiality guarantees, even in the presence of an attacker with access to arbitrary side information. We show that for a…

Cryptography and Security · Computer Science 2008-09-30 Adam Smith
‹ Prev 1 8 9 10 Next ›