English
Related papers

Related papers: Analyzing Privacy Leakage in Machine Learning via …

200 papers

Machine Learning (ML) is crucial in many sectors, including computer vision. However, ML models trained on sensitive data face security challenges, as they can be attacked and leak information. Privacy-Preserving Machine Learning (PPML)…

Machine Learning · Computer Science 2026-02-03 Lucas Lange , Maurice-Maximilian Heykeroth , Erhard Rahm

Differential privacy (DP) is the standard for privacy-preserving analysis, and introduces a fundamental trade-off between privacy guarantees and model performance. Selecting the optimal balance is a critical challenge that can be framed as…

Machine Learning · Computer Science 2025-09-05 Yaohong Yang , Aki Rehn , Sammie Katt , Antti Honkela , Samuel Kaski

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

Cryptography and Security · Computer Science 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Based on differential privacy (DP) framework, we introduce and unify privacy definitions for the multi-armed bandit algorithms. We represent the framework with a unified graphical model and use it to connect privacy definitions. We derive…

Machine Learning · Computer Science 2020-06-25 Debabrota Basu , Christos Dimitrakakis , Aristide Tossou

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

Differential privacy (DP) allows the quantification of privacy loss when the data of individuals is subjected to algorithmic processing such as machine learning, as well as the provision of objective privacy guarantees. However, while…

Cryptography and Security · Computer Science 2021-11-30 Tamara T. Mueller , Alexander Ziller , Dmitrii Usynin , Moritz Knolle , Friederike Jungmann , Daniel Rueckert , Georgios Kaissis

Absolute anonymization, conceived as an irreversible transformation that prevents re-identification and sensitive value disclosure, has proven to be a broken promise. Consequently, modern data protection must shift toward a privacy-utility…

Methodology · Statistics 2026-03-16 Raphaël de Fondeville

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine Learning · Computer Science 2023-01-10 Fred Lu , Joseph Munoz , Maya Fuchs , Tyler LeBlond , Elliott Zaresky-Williams , Edward Raff , Francis Ferraro , Brian Testa

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

The private collection of multiple statistics from a population is a fundamental statistical problem. One possible approach to realize this is to rely on the local model of differential privacy (LDP). Numerous LDP protocols have been…

Cryptography and Security · Computer Science 2023-08-02 Héber H. Arcolezi , Sébastien Gambs , Jean-François Couchot , Catuscia Palamidessi

Differential privacy (DP) is a gold-standard concept of measuring and guaranteeing privacy in data analysis. It is well-known that the cost of adding DP to deep learning model is its accuracy. However, it remains unclear how it affects…

Machine Learning · Computer Science 2021-08-26 Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

Differential privacy (DP) enables private data analysis. In a typical DP deployment, controllers manage individuals' sensitive data and are responsible for answering analysts' queries while protecting individuals' privacy. They do so by…

Databases · Computer Science 2026-05-05 Zhiru Zhu , Raul Castro Fernandez

Differential privacy is often applied with a privacy parameter that is larger than the theory suggests is ideal; various informal justifications for tolerating large privacy parameters have been proposed. In this work, we consider partial…

Cryptography and Security · Computer Science 2022-09-12 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thomas Steinke

Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing privacy-preserving…

Machine Learning · Computer Science 2021-09-28 Hanlin Gu , Lixin Fan , Bowen Li , Yan Kang , Yuan Yao , Qiang Yang

The distributed nature of local differential privacy (LDP) invites data poisoning attacks and poses unforeseen threats to the underlying LDP-supported applications. In this paper, we propose a comprehensive mitigation framework for popular…

Cryptography and Security · Computer Science 2025-06-18 Xiaolin Li , Ninghui Li , Boyang Wang , Wenhai Sun

In differentially private (DP) machine learning, the privacy guarantees of DP mechanisms are often reported and compared on the basis of a single $(\varepsilon, \delta)$-pair. This practice overlooks that DP guarantees can vary…

Cryptography and Security · Computer Science 2025-05-06 Georgios Kaissis , Stefan Kolek , Borja Balle , Jamie Hayes , Daniel Rueckert

For small privacy parameter $\epsilon$, $\epsilon$-differential privacy (DP) provides a strong worst-case guarantee that no membership inference attack (MIA) can succeed at determining whether a person's data was used to train a machine…

Cryptography and Security · Computer Science 2024-02-16 Andrew Lowy , Zhuohang Li , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Ye Wang

Differential privacy (DP) is an essential technique for privacy-preserving. It was found that a large model trained for privacy preserving performs worse than a smaller model (e.g. ResNet50 performs worse than ResNet18). To better…

Machine Learning · Computer Science 2021-11-30 Yinchen Shen , Zhiguo Wang , Ruoyu Sun , Xiaojing Shen

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso