English
Related papers

Related papers: Continual and Sliding Window Release for Private E…

200 papers

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Distributed machine learning is an approach allowing different parties to learn a model over all data sets without disclosing their own data. In this paper, we propose a weighted distributed differential privacy (WD-DP) empirical risk…

Machine Learning · Computer Science 2021-10-22 Yilin Kang , Yong Liu , Weiping Wang

Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data…

Machine Learning · Computer Science 2019-11-11 Erik-Jan van Kesteren , Chang Sun , Daniel L. Oberski , Michel Dumontier , Lianne Ippel

Training with differential privacy (DP) provides a guarantee to members in a dataset that they cannot be identified by users of the released model. However, those data providers, and, in general, the public, lack methods to efficiently…

Machine Learning · Computer Science 2025-12-04 Zoë Ruha Bell , Anvith Thudi , Olive Franzese-McLaughlin , Nicolas Papernot , Shafi Goldwasser

This paper presents a novel approach to classical linear regression, enabling model computation from data streams or in a distributed setting while preserving data privacy in federated environments. We extend this framework to generalized…

Computation · Statistics 2026-05-29 Daniel Tinoco , Raquel Menezes , Carlos Baquero

Firms and statistical agencies must protect the privacy of the individuals whose data they collect, analyze, and publish. Increasingly, these organizations do so by using publication mechanisms that satisfy differential privacy. We consider…

Theoretical Economics · Economics 2024-07-04 Ian M. Schmutte , Nathan Yoder

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

Machine Learning · Computer Science 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

Privacy-preserving distributed processing has recently attracted considerable attention. It aims to design solutions for conducting signal processing tasks over networks in a decentralized fashion without violating privacy. Many algorithms…

Cryptography and Security · Computer Science 2020-09-03 Qiongxiu Li , Jaron Skovsted Gundersen , Richard Heusdens , Mads Græsbøll Christensen

Bounding privacy leakage over compositions, i.e., privacy accounting, is a key challenge in differential privacy (DP). The privacy parameter ($\eps$ or $\delta$) is often easy to estimate but hard to bound. In this paper, we propose a new…

Cryptography and Security · Computer Science 2023-11-22 Jiachen T. Wang , Saeed Mahloujifar , Tong Wu , Ruoxi Jia , Prateek Mittal

Distributed data sharing in dynamic networks is ubiquitous. It raises the concern that the private information of dynamic networks could be leaked when data receivers are malicious or communication channels are insecure. In this paper, we…

Optimization and Control · Mathematics 2019-12-18 Yang Lu , Minghui Zhu

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Stochastic optimization is a pivotal enabler in modern machine learning, producing effective models for various tasks. However, several existing works have shown that model parameters and gradient information are susceptible to privacy…

Machine Learning · Computer Science 2025-09-15 Zhanhong Jiang , Md Zahid Hasan , Nastaran Saadati , Aditya Balu , Chao Liu , Soumik Sarkar

Many privacy mechanisms reveal high-level information about a data distribution through noisy measurements. It is common to use this information to estimate the answers to new queries. In this work, we provide an approach to solve this…

Machine Learning · Computer Science 2019-01-29 Ryan McKenna , Daniel Sheldon , Gerome Miklau

Differential privacy is a recent notion of privacy for statistical databases that provides rigorous, meaningful confidentiality guarantees, even in the presence of an attacker with access to arbitrary side information. We show that for a…

Cryptography and Security · Computer Science 2008-09-30 Adam Smith

The simplest and most widely applied method for guaranteeing differential privacy is to add instance-independent noise to a statistic of interest that is scaled to its global sensitivity. However, global sensitivity is a worst-case notion…

Statistics Theory · Mathematics 2019-06-10 Mark Bun , Thomas Steinke