English
Related papers

Related papers: Chained-DP: Can We Recycle Privacy Budget?

200 papers

This paper presents LDP-Fed, a novel federated learning system with a formal privacy guarantee using local differential privacy (LDP). Existing LDP protocols are developed primarily to ensure data privacy in the collection of single…

Machine Learning · Computer Science 2020-06-09 Stacey Truex , Ling Liu , Ka-Ho Chow , Mehmet Emre Gursoy , Wenqi Wei

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Machine learning (ML) models trained on personal data have been shown to leak information about users. Differential privacy (DP) enables model training with a guaranteed bound on this leakage. Each new model trained with DP increases the…

Cryptography and Security · Computer Science 2021-06-30 Tao Luo , Mingen Pan , Pierre Tholoniat , Asaf Cidon , Roxana Geambasu , Mathias Lécuyer

Local differential privacy (LDP) is a recently proposed privacy standard for collecting and analyzing data, which has been used, e.g., in the Chrome browser, iOS and macOS. In LDP, each user perturbs her information locally, and only sends…

Cryptography and Security · Computer Science 2019-07-02 Ning Wang , Xiaokui Xiao , Yin Yang , Jun Zhao , Siu Cheung Hui , Hyejin Shin , Junbum Shin , Ge Yu

Graph Neural Networks have achieved tremendous success in modeling complex graph data in a variety of applications. However, there are limited studies investigating privacy protection in GNNs. In this work, we propose a learning framework…

Machine Learning · Computer Science 2024-08-07 Karuna Bhaila , Wen Huang , Yongkai Wu , Xintao Wu

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

When training a machine learning model with differential privacy, one sets a privacy budget. This budget represents a maximal privacy violation that any user is willing to face by contributing their data to the training set. We argue that…

Machine Learning · Computer Science 2024-01-22 Franziska Boenisch , Christopher Mühl , Adam Dziedzic , Roy Rinberg , Nicolas Papernot

Federated learning (FL), as a type of collaborative machine learning framework, is capable of preserving private data from mobile terminals (MTs) while training the data into useful models. Nevertheless, from a viewpoint of information…

Machine Learning · Computer Science 2021-02-01 Kang Wei , Jun Li , Ming Ding , Chuan Ma , Hang Su , Bo Zhang , H. Vincent Poor

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

Differential privacy (DP) has arisen as the state-of-the-art metric for quantifying individual privacy when sensitive data are analyzed, and it is starting to see practical deployment in organizations such as the US Census Bureau, Apple,…

Cryptography and Security · Computer Science 2020-04-21 Sameer Wagh , Xi He , Ashwin Machanavajjhala , Prateek Mittal

The rapid growth of smart devices such as phones, wearables, IoT sensors, and connected vehicles has led to an explosion of continuous time series data that offers valuable insights in healthcare, transportation, and more. However, this…

Cryptography and Security · Computer Science 2026-04-01 Bikash Chandra Singh , Md Jakir Hossain , Rafael Diaz , Sandip Roy , Ravi Mukkamala , Sachin Shetty

The distributed nature of local differential privacy (LDP) invites data poisoning attacks and poses unforeseen threats to the underlying LDP-supported applications. In this paper, we propose a comprehensive mitigation framework for popular…

Cryptography and Security · Computer Science 2025-06-18 Xiaolin Li , Ninghui Li , Boyang Wang , Wenhai Sun

To prevent implicit privacy disclosure in sharing gradients among data owners (DOs) under federated learning (FL), differential privacy (DP) and its variants have become a common practice to offer formal privacy guarantees with low…

Computer Science and Game Theory · Computer Science 2023-02-16 Yuntao Wang , Zhou Su , Yanghe Pan , Abderrahim Benslimane , Yiliang Liu , Tom H. Luan , Ruidong Li

Sensitive statistics are often collected across sets of users, with repeated collection of reports done over time. For example, trends in users' private preferences or software usage may be monitored via such reports. We study the…

Machine Learning · Computer Science 2020-07-28 Úlfar Erlingsson , Vitaly Feldman , Ilya Mironov , Ananth Raghunathan , Kunal Talwar , Abhradeep Thakurta

We present new auditors to assess Differential Privacy (DP) of an algorithm based on output samples. Such empirical auditors are common to check for algorithmic correctness and implementation bugs. Most existing auditors are batch-based or…

Cryptography and Security · Computer Science 2026-02-09 Tim Kutta , Martin Dunsche , Yu Wei , Vassilis Zikas

Local Differential Privacy (LDP) is the gold standard trust model for privacy-preserving machine learning by guaranteeing privacy at the data source. However, its application to image data has long been considered impractical due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuanming Cao , Chengqi Li , Wenbo He

Current implementations of differentially-private (DP) systems either lack support to track the global privacy budget consumed on a dataset, or fail to faithfully maintain the state continuity of this budget. We show that failure to…

Cryptography and Security · Computer Science 2024-08-15 Jiankai Jin , Chitchanok Chuengsatiansup , Toby Murray , Benjamin I. P. Rubinstein , Yuval Yarom , Olga Ohrimenko

Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing privacy-preserving…

Machine Learning · Computer Science 2021-09-28 Hanlin Gu , Lixin Fan , Bowen Li , Yan Kang , Yuan Yao , Qiang Yang

In this paper, we aim to develop a scalable algorithm to preserve differential privacy (DP) in adversarial learning for deep neural networks (DNNs), with certified robustness to adversarial examples. By leveraging the sequential composition…

Cryptography and Security · Computer Science 2020-09-16 NhatHai Phan , My T. Thai , Han Hu , Ruoming Jin , Tong Sun , Dejing Dou

Differential Privacy (DP) provides an elegant mathematical framework for defining a provable disclosure risk in the presence of arbitrary adversaries; it guarantees that whether an individual is in a database or not, the results of a DP…

Cryptography and Security · Computer Science 2021-08-19 Aleksandra Slavkovic , Roberto Molinari