English
Related papers

Related papers: Debugging Differential Privacy: A Case Study for P…

200 papers

A surge in data-driven applications enhances everyday life but also raises serious concerns about private information leakage. Hence many privacy auditing tools are emerging for checking if the data sanitization performed meets the privacy…

Cryptography and Security · Computer Science 2024-11-26 Shiming Wang , Liyao Xiang , Bowei Cheng , Zhe Ji , Tianran Sun , Xinbing Wang

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yunhai Han , Sonia Martínez

The importance of deep learning data privacy has gained significant attention in recent years. It is probably to suffer data breaches when applying deep learning to cryptocurrency that lacks supervision of financial regulatory agencies.…

Machine Learning · Computer Science 2022-01-03 Jun-Hao Chen , Yi-Jen Wang , Yun-Cheng Tsai , Samuel Yen-Chi Chen

Differential privacy has emerged as the main definition for private data analysis and machine learning. The {\em global} model of differential privacy, which assumes that users trust the data collector, provides strong privacy guarantees…

Cryptography and Security · Computer Science 2019-10-29 Joshua Allen , Bolin Ding , Janardhan Kulkarni , Harsha Nori , Olga Ohrimenko , Sergey Yekhanin

New regulations and increased awareness of data privacy have led to the deployment of new and more efficient differentially private mechanisms across public institutions and industries. Ensuring the correctness of these mechanisms is…

Cryptography and Security · Computer Science 2023-12-20 William Kong , Andrés Muñoz Medina , Mónica Ribero , Umar Syed

Differential privacy is a de facto standard for statistical computations over databases that contain private data. The strength of differential privacy lies in a rigorous mathematical definition that guarantees individual privacy and yet…

Cryptography and Security · Computer Science 2020-05-05 Gilles Barthe , Rohit Chadha , Vishal Jagannath , A. Prasad Sistla , Mahesh Viswanathan

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

Machine Learning · Computer Science 2019-06-04 Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , Jonathan Ullman

Deep learning models are often trained on datasets that contain sensitive information such as individuals' shopping transactions, personal contacts, and medical records. An increasingly important line of work therefore has sought to train…

Machine Learning · Computer Science 2020-07-23 Zhiqi Bu , Jinshuo Dong , Qi Long , Weijie J. Su

Differential privacy is a popular privacy model within the research community because of the strong privacy guarantee it offers, namely that the presence or absence of any individual in a data set does not significantly influence the…

Cryptography and Security · Computer Science 2017-02-09 Jordi Soria-Comas , Josep Domingo-Ferrer , David Sánchez , David Megías

Differential Privacy (DP) is a key property to protect data and models from integrity attacks. In the Deep Learning (DL) field, it is commonly implemented through the Differentially Private Stochastic Gradient Descent (DP-SGD). However,…

Machine Learning · Computer Science 2023-11-21 Jiménez-López , Daniel , Rodríguez-Barroso , Nuria , Luzón , M. Victoria , Herrera , Francisco

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

Cryptography and Security · Computer Science 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Privacy auditing provides empirical lower bounds on the differential privacy parameters of learning algorithms. Existing methods, however, require interventional access to the training pipeline, either to retrain multiple times or to…

Cryptography and Security · Computer Science 2026-05-15 Tudor Cebere , Mathieu Even , Linus Bleistein , Aurélien Bellet

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Differential privacy has emerged as the most studied framework for privacy-preserving machine learning. However, recent studies show that enforcing differential privacy guarantees can not only significantly degrade the utility of the model,…

Machine Learning · Computer Science 2025-01-27 Kai Yao , Marc Juarez

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Differential privacy (DP) in deep learning is a critical concern as it ensures the confidentiality of training data while maintaining model utility. Existing DP training algorithms provide privacy guarantees by clipping and then injecting…

Machine Learning · Computer Science 2025-04-02 Mingqian Feng , Zeliang Zhang , Jinyang Jiang , Yijie Peng , Chenliang Xu

In this work we study black-box privacy auditing, where the goal is to lower bound the privacy parameter of a differentially private learning algorithm using only the algorithm's outputs (i.e., final trained model). For DP-SGD (the most…

Machine Learning · Computer Science 2025-07-22 Matteo Boglioni , Terrance Liu , Andrew Ilyas , Zhiwei Steven Wu

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

Machine Learning · Computer Science 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Differential privacy (DP) is the de facto standard for private data release and private machine learning. Auditing black-box DP algorithms and mechanisms to certify whether they satisfy a certain DP guarantee is challenging, especially in…

Machine Learning · Computer Science 2022-05-30 Carles Domingo-Enrich , Youssef Mroueh