English
Related papers

Related papers: Privacy Auditing with One (1) Training Run

200 papers

We introduce an end-to-end private deep learning framework, applied to the task of predicting 30-day readmission from electronic health records. By using differential privacy during training and homomorphic encryption during inference, we…

Cryptography and Security · Computer Science 2018-11-27 Edward Chou , Thao Nguyen , Josh Beal , Albert Haque , Li Fei-Fei

Federated learning (FL) is a type of collaborative machine learning where participating peers/clients process their data locally, sharing only updates to the collaborative model. This enables to build privacy-aware distributed machine…

Machine Learning · Computer Science 2023-03-07 Filippo Galli , Sayan Biswas , Kangsoo Jung , Tommaso Cucinotta , Catuscia Palamidessi

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

Machine learning models have recently enjoyed a significant increase in size and popularity. However, this growth has created concerns about dataset privacy. To counteract data leakage, various privacy frameworks guarantee that the output…

Machine Learning · Computer Science 2024-06-05 Coleman DuPlessie , Aidan Gao

Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to…

Machine Learning · Computer Science 2024-01-09 Filippo Galli , Catuscia Palamidessi , Tommaso Cucinotta

Recent years have witnessed the adoption of differential privacy (DP) in practical database systems like PINQ, FLEX, and PrivateSQL. Such systems allow data analysts to query sensitive data while providing a rigorous and provable privacy…

Databases · Computer Science 2023-09-20 Shufan Zhang , Xi He

Linear $L_1$-regularized models have remained one of the simplest and most effective tools in data analysis, especially in information retrieval problems where n-grams over text with TF-IDF or Okapi feature values are a strong and easy…

Machine Learning · Computer Science 2023-03-21 Amol Khanna , Fred Lu , Edward Raff

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

While machine learning has proven to be a powerful data-driven solution to many real-life problems, its use in sensitive domains has been limited due to privacy concerns. A popular approach known as **differential privacy** offers provable…

Machine Learning · Statistics 2016-04-28 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

Auditing Differentially Private Stochastic Gradient Descent (DP-SGD) in the final model setting is challenging and often results in empirical lower bounds that are significantly looser than theoretical privacy guarantees. We introduce a…

Cryptography and Security · Computer Science 2025-02-25 Sangyeon Yoon , Wonje Jeung , Albert No

Deploying machine learning models in production may allow adversaries to infer sensitive information about training data. There is a vast literature analyzing different types of inference risks, ranging from membership inference to…

In recent years, privacy and security concerns in machine learning have promoted trusted federated learning to the forefront of research. Differential privacy has emerged as the de facto standard for privacy protection in federated learning…

Cryptography and Security · Computer Science 2025-10-03 Jie Fu , Yuan Hong , Xinpeng Ling , Leixia Wang , Xun Ran , Zhiyu Sun , Wendy Hui Wang , Zhili Chen , Yang Cao

Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging…

Machine Learning · Computer Science 2025-10-24 Xiang Li , Buxin Su , Chendi Wang , Qi Long , Weijie J. Su

We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy…

Machine Learning · Computer Science 2020-03-26 Aleksei Triastcyn , Boi Faltings

Sampling schemes are fundamental tools in statistics, survey design, and algorithm design. A fundamental result in differential privacy is that a differentially private mechanism run on a simple random sample of a population provides…

Methodology · Statistics 2023-06-23 Mark Bun , Jörg Drechsler , Marco Gaboardi , Audra McMillan , Jayshree Sarathy

With the increasing demands for privacy protection, many privacy-preserving machine learning systems were proposed in recent years. However, most of them cannot be put into production due to their slow training and inference speed caused by…

Cryptography and Security · Computer Science 2020-08-19 Fei Zheng

The applicability of process mining techniques hinges on the availability of event logs capturing the execution of a business process. In some use cases, particularly those involving customer-facing processes, these event logs may contain…

Cryptography and Security · Computer Science 2022-12-16 Gamal Elkoumy , Alisa Pankova , Marlon Dumas

Modern machine learning systems use models trained on ever-growing corpora. Typically, metadata such as ownership, access control, or licensing information is ignored during training. Instead, to mitigate privacy risks, we rely on generic…