English
Related papers

Related papers: General Lower Bounds for Differentially Private Fe…

200 papers

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it a promising approach for privacy-preserving machine learning. However, ensuring differential privacy (DP) in FL…

Machine Learning · Computer Science 2025-03-28 Kanishka Ranaweera , David Smith , Pubudu N. Pathirana , Ming Ding , Thierry Rakotoarivelo , Aruna Seneviratne

We present HDP-VFL, the first hybrid differentially private (DP) framework for vertical federated learning (VFL) to demonstrate that it is possible to jointly learn a generalized linear model (GLM) from vertically partitioned data with only…

Machine Learning · Computer Science 2020-09-08 Chang Wang , Jian Liang , Mingkai Huang , Bing Bai , Kun Bai , Hao Li

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

In many applications, the labeled data at the learner's disposal is subject to privacy constraints and is relatively limited. To derive a more accurate predictor for the target domain, it is often beneficial to leverage publicly available…

Machine Learning · Computer Science 2024-02-06 Raef Bassily , Corinna Cortes , Anqi Mao , Mehryar Mohri

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction --…

Federated learning (FL) faces two primary challenges: the risk of privacy leakage due to parameter sharing and communication inefficiencies. To address these challenges, we propose DPSFL, a federated learning method that utilizes…

Machine Learning · Computer Science 2024-10-11 Meifan Zhang , Zhanhong Xie , Lihua Yin

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

This paper introduces \texttt{FedMPDD} (\textbf{Fed}erated Learning via \textbf{M}ulti-\textbf{P}rojected \textbf{D}irectional \textbf{D}erivatives), a novel algorithm that simultaneously optimizes bandwidth utilization and enhances privacy…

Machine Learning · Computer Science 2025-12-25 Mohammadreza Rostami , Solmaz S. Kia

Fingerprinting arguments, first introduced by Bun, Ullman, and Vadhan (STOC 2014), are the most widely used method for establishing lower bounds on the sample complexity or error of approximately differentially private (DP) algorithms.…

Cryptography and Security · Computer Science 2024-07-08 Naty Peter , Eliad Tsfadia , Jonathan Ullman

Decentralized Federated Learning (FL) has attracted significant attention due to its enhanced robustness and scalability compared to its centralized counterpart. It pivots on peer-to-peer communication rather than depending on a central…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-14 Qiongxiu Li , Wenrui Yu , Changlong Ji , Richard Heusdens

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

Federated Learning enables a population of clients, working with a trusted server, to collaboratively learn a shared machine learning model while keeping each client's data within its own local systems. This reduces the risk of exposing…

Cryptography and Security · Computer Science 2020-10-13 David Byrd , Antigoni Polychroniadou

Differential privacy (DP) techniques can be applied to the federated learning model to statistically guarantee data privacy against inference attacks to communication among the learning agents. While ensuring strong data privacy, however,…

Machine Learning · Computer Science 2022-02-22 Minseok Ryu , Kibaek Kim

Federated learning has attracted significant recent attention due to its applicability across a wide range of settings where data is collected and analyzed across disparate locations. In this paper, we study federated nonparametric…

Statistics Theory · Mathematics 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

We investigate the contraction properties of locally differentially private mechanisms. More specifically, we derive tight upper bounds on the divergence between $PK$ and $QK$ output distributions of an $\epsilon$-LDP mechanism $K$ in terms…

Information Theory · Computer Science 2024-05-06 Shahab Asoodeh , Huanyu Zhang

Sequential querying of differentially private mechanisms degrades the overall privacy level. In this paper, we answer the fundamental question of characterizing the level of overall privacy degradation as a function of the number of queries…

Data Structures and Algorithms · Computer Science 2015-12-08 Peter Kairouz , Sewoong Oh , Pramod Viswanath

Randomized response, as a basic building-block for differentially private mechanism, has given rise to great interest and found various potential applications in science communities. In this work, we are concerned with three-elements…

Cryptography and Security · Computer Science 2021-12-15 Fei Ma , Ping Wang

This paper presents a differentially private algorithm for linear regression learning in a decentralized fashion. Under this algorithm, privacy budget is theoretically derived, in addition to that the solution error is shown to be bounded…

Cryptography and Security · Computer Science 2020-04-17 Yang Liu , Xiong Zhang , Shuqi Qin , Xiaoping Lei

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless,…

Machine Learning · Computer Science 2023-02-17 Zhe Li , Honglong Chen , Zhichen Ni , Huajie Shao