English
Related papers

Related papers: Privacy Amplification by Mixing and Diffusion Mech…

200 papers

In many practical applications of differential privacy, practitioners seek to provide the best privacy guarantees subject to a target level of accuracy. A recent line of work by Ligett et al. '17 and Whitehouse et al. '22 has developed such…

Cryptography and Security · Computer Science 2023-12-07 Ryan Rogers , Gennady Samorodnitsky , Zhiwei Steven Wu , Aaditya Ramdas

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Differential Privacy (DP) mechanisms, especially in high-dimensional settings, often face the challenge of maintaining privacy without compromising the data utility. This work introduces an innovative shuffling mechanism in…

Machine Learning · Computer Science 2024-07-23 Jungang Yang , Zhe Ji , Liyao Xiang

For the modeling, design and planning of future energy transmission networks, it is vital for stakeholders to access faithful and useful power flow data, while provably maintaining the privacy of business confidentiality of service…

Cryptography and Security · Computer Science 2021-03-29 David Smith , Frederik Geth , Elliott Vercoe , Andrew Feutrill , Ming Ding , Jonathan Chan , James Foster , Thierry Rakotoarivelo

The Sampled Gaussian Mechanism (SGM)---a composition of subsampling and the additive Gaussian noise---has been successfully used in a number of machine learning applications. The mechanism's unexpected power is derived from privacy…

Machine Learning · Computer Science 2019-08-29 Ilya Mironov , Kunal Talwar , Li Zhang

As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal…

Signal Processing · Electrical Eng. & Systems 2020-10-23 Qiongxiu Li , Richard Heusdens , Mads Græsbøll Christensen

Data privacy protection is garnering increased attention among researchers. Diffusion models (DMs), particularly with strict differential privacy, can potentially produce images with both high privacy and visual quality. However, challenges…

Machine Learning · Computer Science 2024-12-09 Qipan Xu , Youlong Ding , Xinxi Zhang , Jie Gao , Hao Wang

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

Many forms of sensitive data, such as web traffic, mobility data, or hospital occupancy, are inherently sequential. The standard method for training machine learning models while ensuring privacy for units of sensitive information, such as…

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

We study the privacy risks that are associated with training a neural network's weights with self-supervised learning algorithms. Through empirical evidence, we show that the fine-tuning stage, in which the network weights are updated with…

Machine Learning · Computer Science 2022-05-26 Yunhao Yang , Parham Gohari , Ufuk Topcu

Gaussian sketching, which consists of pre-multiplying the data with a random Gaussian matrix, is a widely used technique for multiple problems in data science and machine learning, with applications spanning computationally efficient…

Machine Learning · Computer Science 2025-06-05 Omri Lev , Vishwak Srinivasan , Moshe Shenfeld , Katrina Ligett , Ayush Sekhari , Ashia C. Wilson

Gaussian differential privacy (GDP) is a single-parameter family of privacy notions that provides coherent guarantees to avoid the exposure of sensitive individual information. Despite the extra interpretability and tighter bounds under…

Cryptography and Security · Computer Science 2022-10-18 Yi Liu , Ke Sun , Linglong Kong , Bei Jiang

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

Statistics Theory · Mathematics 2022-11-01 Jason M. Altschuler , Kunal Talwar

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

Report Noisy Max and Above Threshold are two classical differentially private (DP) selection mechanisms. Their output is obtained by adding noise to a sequence of low-sensitivity queries and reporting the identity of the query whose (noisy)…

Machine Learning · Computer Science 2024-03-22 Jonathan Lebensold , Doina Precup , Borja Balle

Differential Privacy protects individuals' data when statistical queries are published from aggregated databases: applying "obfuscating" mechanisms to the query results makes the released information less specific but, unavoidably, also…

Cryptography and Security · Computer Science 2021-07-27 Natasha Fernandes , Annabelle McIver , Carroll Morgan

Differentially private noise mechanisms commonly use symmetric noise distributions. This is attractive both for achieving the differential privacy definition, and for unbiased expectations in the noised answers. However, there are contexts…

Cryptography and Security · Computer Science 2021-10-18 Benjamin M. Case , James Honaker , Mahnush Movahedi

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce…

Cryptography and Security · Computer Science 2024-02-02 Richeng Jin , Zhonggen Su , Caijun Zhong , Zhaoyang Zhang , Tony Quek , Huaiyu Dai

The design of a statistical signal processing privacy problem is studied where the private data is assumed to be observable. In this work, an agent observes useful data $Y$, which is correlated with private data $X$, and wants to disclose…

Information Theory · Computer Science 2023-09-19 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund