English
Related papers

Related papers: Differentially Private Auditing Under Strategic Re…

200 papers

Auditing Differentially Private Stochastic Gradient Descent (DP-SGD) in the final model setting is challenging and often results in empirical lower bounds that are significantly looser than theoretical privacy guarantees. We introduce a…

Cryptography and Security · Computer Science 2025-02-25 Sangyeon Yoon , Wonje Jeung , Albert No

To resolve the acute problem of privacy protection and guarantee that data can be used in the context of threat intelligence, this paper considers the implementation of Differential Privacy (DP) in cybersecurity analytics. DP, which is a…

Cryptography and Security · Computer Science 2026-01-05 Brahim Khalil Sedraoui , Abdelmadjid Benmachiche , Amina Makhlouf , Chaouki Chemam

While significant progress has been made separately on analytics systems for scalable stochastic gradient descent (SGD) and private SGD, none of the major scalable analytics frameworks have incorporated differentially private SGD. There are…

Machine Learning · Computer Science 2017-03-24 Xi Wu , Fengan Li , Arun Kumar , Kamalika Chaudhuri , Somesh Jha , Jeffrey F. Naughton

In this paper we propose new methods to statistically assess $f$-Differential Privacy ($f$-DP), a recent refinement of differential privacy (DP) that remedies certain weaknesses of standard DP (including tightness under algorithmic…

Cryptography and Security · Computer Science 2025-06-16 Önder Askin , Holger Dette , Martin Dunsche , Tim Kutta , Yun Lu , Yu Wei , Vassilis Zikas

This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Wei Huo , Xiaomeng Chen , Lingying Huang , Karl Henrik Johansson , Ling Shi

Machine learning models can be trained with formal privacy guarantees via differentially private optimizers such as DP-SGD. In this work, we focus on a threat model where the adversary has access only to the final model, with no visibility…

Machine Learning · Computer Science 2025-05-30 Tudor Cebere , Aurélien Bellet , Nicolas Papernot

Artificial Intelligence (AI) models are vulnerable to information leakage of their training data, which can be highly sensitive, for example in medical imaging. Privacy Enhancing Technologies (PETs), such as Differential Privacy (DP), aim…

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies. Motivated by the data privacy concerns invoked…

Machine Learning · Statistics 2026-04-09 Achraf Azize , Marc Jourdan , Aymen Al Marjani , Debabrota Basu

Differentially private (DP) optimization has been widely adopted as a standard approach to provide rigorous privacy guarantees for training datasets. DP auditing verifies whether a model trained with DP optimization satisfies its claimed…

Cryptography and Security · Computer Science 2025-07-08 Ruixuan Liu , Li Xiong

For enhancing the privacy protections of databases, where the increasing amount of detailed personal data is stored and processed, multiple mechanisms have been developed, such as audit logging and alert triggers, which notify…

Artificial Intelligence · Computer Science 2018-01-23 Chao Yan , Bo Li , Yevgeniy Vorobeychik , Aron Laszka , Daniel Fabbri , Bradley Malin

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Developing machine learning methods that are privacy preserving is today a central topic of research, with huge practical impacts. Among the numerous ways to address privacy-preserving learning, we here take the perspective of computing the…

Machine Learning · Computer Science 2021-07-06 Alain Rakotomamonjy , Liva Ralaivola

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Stochastic optimization is a pivotal enabler in modern machine learning, producing effective models for various tasks. However, several existing works have shown that model parameters and gradient information are susceptible to privacy…

Machine Learning · Computer Science 2025-09-15 Zhanhong Jiang , Md Zahid Hasan , Nastaran Saadati , Aditya Balu , Chao Liu , Soumik Sarkar

Differentially private stochastic gradient descent (DP-SGD) enables private deep learning through per-example clipping and calibrated Gaussian noise, but its high-variance updates can reduce utility on challenging datasets. We propose…

Machine Learning · Computer Science 2026-05-21 Mohammad Partohaghighi , Roummel Marcia

This paper introduces a novel theoretical framework for auditing differential privacy (DP) in a black-box setting. Leveraging the concept of $f$-differential privacy, we explicitly define type I and type II errors and propose an auditing…

Methodology · Statistics 2025-04-14 Kaining Shi , Cong Ma

Prior work on differential privacy analysis of randomized SGD algorithms relies on composition theorems, where the implicit (unrealistic) assumption is that the internal state of the iterative algorithm is revealed to the adversary. As a…

Machine Learning · Statistics 2022-10-18 Jiayuan Ye , Reza Shokri