English
Related papers

Related papers: Bounding, Concentrating, and Truncating: Unifying …

200 papers

The dire need to protect sensitive data has led to various flavors of privacy definitions. Among these, Differential privacy (DP) is considered one of the most rigorous and secure notions of privacy, enabling data analysis while preserving…

Cryptography and Security · Computer Science 2025-06-09 Amir Gilad , Tova Milo , Kathy Razmadze , Ron Zadicario

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic

Privacy is a growing concern in modern deep-learning systems and applications. Differentially private (DP) training prevents the leakage of sensitive information in the collected training data from the trained machine learning models. DP…

Machine Learning · Computer Science 2024-08-28 Xinwei Zhang , Zhiqi Bu , Mingyi Hong , Meisam Razaviyayn

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

We show a new lower bound on the sample complexity of $(\varepsilon, \delta)$-differentially private algorithms that accurately answer statistical queries on high-dimensional databases. The novelty of our bound is that it depends optimally…

Data Structures and Algorithms · Computer Science 2015-01-27 Thomas Steinke , Jonathan Ullman

Nowadays, differential privacy (DP) has become a well-accepted standard for privacy protection, and deep neural networks (DNN) have been immensely successful in machine learning. The combination of these two techniques, i.e., deep learning…

Cryptography and Security · Computer Science 2024-08-02 Jianxin Wei , Ergute Bao , Xiaokui Xiao , Yin Yang

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Differential privacy (DP) allows the quantification of privacy loss when the data of individuals is subjected to algorithmic processing such as machine learning, as well as the provision of objective privacy guarantees. However, while…

Cryptography and Security · Computer Science 2021-11-30 Tamara T. Mueller , Alexander Ziller , Dmitrii Usynin , Moritz Knolle , Friederike Jungmann , Daniel Rueckert , Georgios Kaissis

High quality data is needed to unlock the full potential of AI for end users. However finding new sources of such data is getting harder: most publicly-available human generated data will soon have been used. Additionally, publicly…

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Privacy preserving data analysis (PPDA) has received increasing attention due to a great variety of applications. Local differential privacy (LDP), as an emerging standard that is suitable for PPDA, has been widely deployed into various…

Cryptography and Security · Computer Science 2021-12-10 Fei Ma , Renbo Zhu , Ping Wang

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL). As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge. This…

The standard definition of differential privacy (DP) ensures that a mechanism's output distribution on adjacent datasets is indistinguishable. However, real-world implementations of DP can, and often do, reveal information through their…

Cryptography and Security · Computer Science 2024-11-26 Zachary Ratliff , Salil Vadhan

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

Surveys are an important tool for many areas of social science research, but privacy concerns can complicate the collection and analysis of survey data. Differentially private analyses of survey data can address these concerns, but at the…

Cryptography and Security · Computer Science 2022-09-23 Krystal Maughan , Joseph P. Near

To protect user privacy in data analysis, a state-of-the-art strategy is differential privacy in which scientific noise is injected into the real analysis output. The noise masks individual's sensitive information contained in the dataset.…

Cryptography and Security · Computer Science 2018-06-20 Xuan-Son Vu , Lili Jiang

Datasets containing sensitive information are often sequentially analyzed by many algorithms. This raises a fundamental question in differential privacy regarding how the overall privacy bound degrades under composition. To address this…

Machine Learning · Statistics 2020-03-26 Qinqing Zheng , Jinshuo Dong , Qi Long , Weijie J. Su