English
Related papers

Related papers: An end-to-end Differentially Private Latent Dirich…

200 papers

Differential Privacy (DP) provides strong guarantees on the risk of compromising a user's data in statistical learning applications, though these strong protections make learning challenging and may be too stringent for some use cases. To…

Machine Learning · Computer Science 2019-12-10 Hilal Asi , John Duchi , Omid Javidbakht

The internet of things (IoT) is transforming major industries including but not limited to healthcare, agriculture, finance, energy, and transportation. IoT platforms are continually improving with innovations such as the amalgamation of…

Machine Learning · Computer Science 2019-11-12 M. A. P. Chamikara , P. Bertok , I. Khalil , D. Liu , S. Camtepe , M. Atiquzzaman

Private machine learning involves addition of noise while training, resulting in lower accuracy. Intuitively, greater stability can imply greater privacy and improve this privacy-utility tradeoff. We study this role of stability in private…

Machine Learning · Computer Science 2020-06-26 Lauren Watson , Benedek Rozemberczki , Rik Sarkar

Layer-wise Gaussian mechanisms (LGM) enhance flexibility in differentially private deep learning by injecting noise into partitioned gradient vectors. However, existing methods often rely on heuristic noise allocation strategies, lacking a…

Machine Learning · Computer Science 2025-10-20 Qifeng Tan , Shusen Yang , Xuebin Ren , Yikai Zhang

We propose a novel algorithm to ensure $\epsilon$-differential privacy for answering range queries on trajectory data. In order to guarantee privacy, differential privacy mechanisms add noise to either data or query, thus introducing errors…

Databases · Computer Science 2019-07-19 Soheila Ghane , Lars Kulik , Kotagiri Ramamohanarao

Recent developments have underscored the critical role of \textit{differential privacy} (DP) in safeguarding individual data for training machine learning models. However, integrating DP oftentimes incurs significant model performance…

Machine Learning · Computer Science 2024-03-06 Zihao Wang , Rui Zhu , Dongruo Zhou , Zhikun Zhang , John Mitchell , Haixu Tang , XiaoFeng Wang

Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches proposed so far achieve these guarantees but severely reduce model accuracy. We propose sequential…

Machine Learning · Computer Science 2026-01-09 Polina Dolgova , Sebastian U. Stich

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model.…

Machine Learning · Computer Science 2021-09-13 Zhicong Liang , Bao Wang , Quanquan Gu , Stanley Osher , Yuan Yao

Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the…

Machine Learning · Computer Science 2019-10-16 Frederik Harder , Jonas Köhler , Max Welling , Mijung Park

This paper proposes a differentially private gradient-tracking-based distributed stochastic optimization algorithm over directed graphs. In particular, privacy noises are incorporated into each agent's state and tracking variable to…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Jialong Chen , Jimin Wang , Ji-Feng Zhang

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

This paper establishes the strict optimality in precision for frequency and distribution estimation under local differential privacy (LDP). We prove that a linear estimator with a symmetric and extremal configuration, and a constant support…

Information Theory · Computer Science 2026-03-24 Mingen Pan

The arguably most widely employed algorithm to train deep neural networks with Differential Privacy is DPSGD, which requires clipping and noising of per-sample gradients. This introduces a reduction in model utility compared to non-private…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Nicolas W. Remerscheid , Alexander Ziller , Daniel Rueckert , Georgios Kaissis

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

User-level differentially private stochastic convex optimization (DP-SCO) has garnered significant attention due to the paramount importance of safeguarding user privacy in modern large-scale machine learning applications. Current methods,…

Machine Learning · Computer Science 2025-02-14 Badih Ghazi , Ravi Kumar , Daogao Liu , Pasin Manurangsi