English
Related papers

Related papers: Average-Case Averages: Private Algorithms for Smoo…

200 papers

Local differential privacy (LDP) is a strong privacy standard that has been adopted by popular software systems. The main idea is that each individual perturbs their own data locally, and only submits the resulting noisy version to a data…

Cryptography and Security · Computer Science 2024-04-04 Fei Wei , Ergute Bao , Xiaokui Xiao , Yin Yang , Bolin Ding

Suppose each user $i$ holds a private value $x_i$ in some metric space $(U, \mathrm{dist})$, and an untrusted data analyst wishes to compute $\sum_i f(x_i)$ for some function $f : U \rightarrow \mathbb{R}$ by asking each user to send in a…

Cryptography and Security · Computer Science 2024-05-13 Yuting Liang , Ke Yi

We develop lower bounds for estimation under local privacy constraints---including differential privacy and its relaxations to approximate or R\'{e}nyi differential privacy---by showing an equivalence between private estimation and…

Statistics Theory · Mathematics 2019-05-07 John Duchi , Ryan Rogers

It is difficult to continually update private machine learning models with new data while maintaining privacy. Data incur increasing privacy loss -- as measured by differential privacy -- when they are used in repeated computations. In this…

Machine Learning · Computer Science 2022-03-08 Lauren Watson , Abhirup Ghosh , Benedek Rozemberczki , Rik Sarkar

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

We consider the problem of privately estimating the mean of vectors distributed across different nodes of an unreliable wireless network, where communications between nodes can fail intermittently. We adopt a semi-decentralized setup,…

Signal Processing · Electrical Eng. & Systems 2024-06-07 Rajarshi Saha , Mohamed Seif , Michal Yemini , Andrea J. Goldsmith , H. Vincent Poor

We consider a sequential setting in which a single dataset of individuals is used to perform adaptively-chosen analyses, while ensuring that the differential privacy loss of each participant does not exceed a pre-specified privacy budget.…

Cryptography and Security · Computer Science 2022-01-11 Vitaly Feldman , Tijana Zrnic

Two major challenges in distributed learning and estimation are 1) preserving the privacy of the local samples; and 2) communicating them efficiently to a central server, while achieving high accuracy for the end-to-end task. While there…

Machine Learning · Computer Science 2021-04-23 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür

We study the problem of differentially private clustering under input-stability assumptions. Despite the ever-growing volume of works on differential privacy in general and differentially private clustering in particular, only three works…

Machine Learning · Computer Science 2021-12-20 Moshe Shechner

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

This work considers the problem of Distributed Mean Estimation (DME) over networks with intermittent connectivity, where the goal is to learn a global statistic over the data samples localized across distributed nodes with the help of a…

Information Theory · Computer Science 2023-03-02 Rajarshi Saha , Mohamed Seif , Michal Yemini , Andrea J. Goldsmith , H. Vincent Poor

We present an optimization framework for solving multi-agent nonlinear programs subject to inequality constraints while keeping the agents' state trajectories private. Each agent has an objective function depending only upon its own state…

Optimization and Control · Mathematics 2016-08-03 Matthew Hale , Magnus Egerstedt

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso

This paper considers estimation of a quantized constant in noise when using uniform and nonuniform quantizers. Estimators based on simple arithmetic averages, on sample statistical moments and on the maximum-likelihood procedure are…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Antonio Moschitta , Johan Schoukens , Paolo Carbone

Privacy protection has become an increasingly pressing requirement in distributed optimization. However, equipping distributed optimization with differential privacy, the state-of-the-art privacy protection mechanism, will unavoidably…

Optimization and Control · Mathematics 2023-04-28 Yu Xuan , Yongqiang Wang

A key challenge in many modern data analysis tasks is that user data are heterogeneous. Different users may possess vastly different numbers of data points. More importantly, it cannot be assumed that all users sample from the same…

Cryptography and Security · Computer Science 2023-08-01 Rachel Cummings , Vitaly Feldman , Audra McMillan , Kunal Talwar

Differential privacy provides the first theoretical foundation with provable privacy guarantee against adversaries with arbitrary prior knowledge. The main idea to achieve differential privacy is to inject random noise into statistical…

Data Structures and Algorithms · Computer Science 2011-11-01 Yang D. Li , Zhenjie Zhang , Marianne Winslett , Yin Yang

We propose a new differentially-private decision forest algorithm that minimizes both the number of queries required, and the sensitivity of those queries. To do so, we build an ensemble of random decision trees that avoids querying the…

Cryptography and Security · Computer Science 2021-08-25 Sam Fletcher , Md Zahidul Islam

When querying databases containing sensitive information, the privacy of individuals stored in the database has to be guaranteed. Such guarantees are provided by differentially private mechanisms which add controlled noise to the query…

Databases · Computer Science 2020-08-26 William Lee Croft , Jörg-Rüdiger Sack , Wei Shi

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

Machine Learning · Computer Science 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons