English
Related papers

Related papers: Interaction is necessary for distributed learning …

200 papers

In this paper, we investigate federated learning for quantile inference under local differential privacy (LDP). We propose an estimator based on local stochastic gradient descent (SGD), whose local gradients are perturbed via a randomized…

Methodology · Statistics 2025-09-29 Leheng Cai , Qirui Hu , Shuyuan Wu

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Local Differential Privacy (LDP) is popularly used in practice for privacy-preserving data collection. Although existing LDP protocols offer high utility for large user populations (100,000 or more users), they perform poorly in scenarios…

Cryptography and Security · Computer Science 2019-10-22 Mehmet Emre Gursoy , Acar Tamersoy , Stacey Truex , Wenqi Wei , Ling Liu

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

We introduce a locally differentially private (LDP) algorithm for online federated learning that employs temporally correlated noise to improve utility while preserving privacy. To address challenges posed by the correlated noise and local…

Machine Learning · Computer Science 2025-03-13 Jiaojiao Zhang , Linglingzhi Zhu , Dominik Fay , Mikael Johansson

Local differential privacy (LDP) is a variant of differential privacy (DP) that avoids the need for a trusted central curator, at the cost of a worse trade-off between privacy and utility. The shuffle model is a way to provide greater…

Cryptography and Security · Computer Science 2023-05-23 Mireya Jurado , Ramon G. Gonze , Mário S. Alvim , Catuscia Palamidessi

Differential privacy protects an individual's privacy by perturbing data on an aggregated level (DP) or individual level (LDP). We report four online human-subject experiments investigating the effects of using different approaches to…

Cryptography and Security · Computer Science 2020-04-01 Aiping Xiong , Tianhao Wang , Ninghui Li , Somesh Jha

Distributed learning systems have enabled training large-scale models over large amount of data in significantly shorter time. In this paper, we focus on decentralized distributed deep learning systems and aim to achieve differential…

Machine Learning · Computer Science 2018-11-28 Hsin-Pai Cheng , Patrick Yu , Haojing Hu , Feng Yan , Shiyu Li , Hai Li , Yiran Chen

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

Most deep learning frameworks require users to pool their local data or model updates to a trusted server to train or maintain a global model. The assumption of a trusted server who has access to user information is ill-suited in many…

Machine Learning · Computer Science 2020-06-26 Lingjuan Lyu , Yitong Li , Xuanli He , Tong Xiao

In this work, we investigate the problem of public data assisted non-interactive Local Differentially Private (LDP) learning with a focus on non-parametric classification. Under the posterior drift assumption, we for the first time derive…

Machine Learning · Statistics 2024-06-04 Yuheng Ma , Hanfang Yang

Federated learning is a machine learning setting where a set of edge devices collaboratively train a model under the orchestration of a central server without sharing their local data. At each communication round of federated learning, edge…

Machine Learning · Computer Science 2020-09-23 Rui Hu , Yuanxiong Guo , Yanmin Gong

Synthetic data from generative models emerges as the privacy-preserving data sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. Till date, the prior focus on…

Machine Learning · Computer Science 2025-07-23 Chaoyi Zhu , Jiayi Tang , Juan F. Pérez , Marten van Dijk , Lydia Y. Chen

Data privacy and decentralised data collection has become more and more popular in recent years. In order to solve issues with privacy, communication bandwidth and learning from spatio-temporal data, we will propose two efficient models…

Machine Learning · Computer Science 2023-01-19 Timon Sachweh , Daniel Boiar , Thomas Liebig

Local differential privacy (LDP), a technique applying unbiased statistical estimations instead of real data, is often adopted in data collection. In particular, this technique is used with frequency oracles (FO) because it can protect each…

Cryptography and Security · Computer Science 2022-03-29 Dan Zhao , Suyun Zhao , Ruixuan Liu , Cuiping Li , Wenjuan Liang , Hong Chen

Federated Learning (FL) enables collaborative model training without direct data sharing, yet it remains vulnerable to privacy attacks such as model inversion and membership inference. Existing differential privacy (DP) solutions for FL…

Cryptography and Security · Computer Science 2026-01-06 Yunbo Li , Jiaping Gui , Fanchao Meng , Yue Wu

Federated learning (FL), as a type of collaborative machine learning framework, is capable of preserving private data from mobile terminals (MTs) while training the data into useful models. Nevertheless, from a viewpoint of information…

Machine Learning · Computer Science 2021-02-01 Kang Wei , Jun Li , Ming Ding , Chuan Ma , Hang Su , Bo Zhang , H. Vincent Poor

Local differential privacy (LDP) has emerged as a promising paradigm for privacy-preserving data collection in distributed systems, where users contribute multi-dimensional records with potentially correlated attributes. Recent work has…

Cryptography and Security · Computer Science 2025-08-20 Sandaru Jayawardana , Sennur Ulukus , Ming Ding , Kanchana Thilakarathna

The introduction and advancements in Local Differential Privacy (LDP) variants have become a cornerstone in addressing the privacy concerns associated with the vast data produced by smart devices, which forms the foundation for data-driven…

Cryptography and Security · Computer Science 2023-09-13 Likun Qin , Nan Wang , Tianshuo Qiu