English
Related papers

Related papers: A General Framework for Auditing Differentially Pr…

200 papers

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy…

Machine Learning · Computer Science 2020-03-26 Aleksei Triastcyn , Boi Faltings

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Differential privacy has become the dominant standard in the research community for strong privacy protection. There has been a flood of research into query answering algorithms that meet this standard. Algorithms are becoming increasingly…

Databases · Computer Science 2015-12-16 Michael Hay , Ashwin Machanavajjhala , Gerome Miklau , Yan Chen , Dan Zhang

Recent advancements in privacy-preserving machine learning are paving the way to extend the benefits of ML to highly sensitive data that, until now, have been hard to utilize due to privacy concerns and regulatory constraints.…

Cryptography and Security · Computer Science 2024-09-24 Hidde Lycklama , Alexander Viand , Nicolas Küchler , Christian Knabenhans , Anwar Hithnawi

Differentially private machine learning trains models while protecting privacy of the sensitive training data. The key to obtain differentially private models is to introduce noise/randomness to the training process. In particular, existing…

Cryptography and Security · Computer Science 2020-08-25 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not…

Machine Learning · Computer Science 2020-10-08 Tao Zhang , Tianqing Zhu , Ping Xiong , Huan Huo , Zahir Tari , Wanlei Zhou

Fairness auditing of AI systems can identify and quantify biases. However, traditional auditing using real-world data raises security and privacy concerns. It exposes auditors to security risks as they become custodians of sensitive…

Computers and Society · Computer Science 2025-05-01 Chih-Cheng Rex Yuan , Bow-Yaw Wang

Federated learning (FL) is a type of collaborative machine learning where participating peers/clients process their data locally, sharing only updates to the collaborative model. This enables to build privacy-aware distributed machine…

Machine Learning · Computer Science 2023-03-07 Filippo Galli , Sayan Biswas , Kangsoo Jung , Tommaso Cucinotta , Catuscia Palamidessi

When training a machine learning model, it is standard procedure for the researcher to have full knowledge of both the data and model. However, this engenders a lack of trust between data owners and data scientists. Data owners are…

Cryptography and Security · Computer Science 2020-09-24 Will Abramson , Adam James Hall , Pavlos Papadopoulos , Nikolaos Pitropakis , William J Buchanan

Quantum algorithms for solving a wide range of practical problems have been proposed in the last ten years, such as data search and analysis, product recommendation, and credit scoring. The concern about privacy and other ethical issues in…

Quantum Physics · Physics 2023-09-12 Ji Guan , Wang Fang , Mingyu Huang , Mingsheng Ying

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

Auditing algorithms' privacy typically involves simulating a game-based protocol that guesses which of two adjacent datasets was the original input. Traditional approaches require thousands of such simulations, leading to significant…

Cryptography and Security · Computer Science 2025-01-30 Zihang Xiang , Tianhao Wang , Di Wang

The explosive growth of machine learning has made it a critical infrastructure in the era of artificial intelligence. The extensive use of data poses a significant threat to individual privacy. Various countries have implemented…

Cryptography and Security · Computer Science 2024-06-11 Hengzhu Liu , Ping Xiong , Tianqing Zhu , Philip S. Yu

Differential privacy is a de facto standard for statistical computations over databases that contain private data. The strength of differential privacy lies in a rigorous mathematical definition that guarantees individual privacy and yet…

Cryptography and Security · Computer Science 2020-05-05 Gilles Barthe , Rohit Chadha , Vishal Jagannath , A. Prasad Sistla , Mahesh Viswanathan

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

Objective: To enable privacy-preserving learning of high quality generative and discriminative machine learning models from distributed electronic health records. Methods and Results: We describe general and scalable strategy to build…

Cryptography and Security · Computer Science 2018-06-19 Marina Blanton , Ah Reum Kang , Subhadeep Karan , Jaroslaw Zola

Recent research has shown that structured machine learning models such as tree ensembles are vulnerable to privacy attacks targeting their training data. To mitigate these risks, differential privacy (DP) has become a widely adopted…

Machine Learning · Computer Science 2026-01-07 Alice Gorgé , Julien Ferry , Sébastien Gambs , Thibaut Vidal

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler