English
Related papers

Related papers: Privacy- and Utility-Preserving Textual Analysis v…

200 papers

Hierarchical text classification consists in classifying text documents into a hierarchy of classes and sub-classes. Although artificial neural networks have proved useful to perform this task, unfortunately they can leak training data…

Cryptography and Security · Computer Science 2021-12-10 Dominik Wunderlich , Daniel Bernau , Francesco Aldà , Javier Parra-Arnau , Thorsten Strufe

We show that adding differential privacy to Explainable Boosting Machines (EBMs), a recent method for training interpretable ML models, yields state-of-the-art accuracy while protecting privacy. Our experiments on multiple classification…

Machine Learning · Computer Science 2021-06-18 Harsha Nori , Rich Caruana , Zhiqi Bu , Judy Hanwen Shen , Janardhan Kulkarni

Privacy is an important concern when building statistical models on data containing personal information. Differential privacy offers a strong definition of privacy and can be used to solve several privacy concerns (Dwork et al., 2014).…

Cryptography and Security · Computer Science 2021-02-03 Satyapriya Krishna , Rahul Gupta , Christophe Dupuy

Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…

Cryptography and Security · Computer Science 2021-10-20 Aman Bansal , Rahul Chunduru , Deepesh Data , Manoj Prabhakaran

Deep learning models leak significant amounts of information about their training datasets. Previous work has investigated training models with differential privacy (DP) guarantees through adding DP noise to the gradients. However, such…

Machine Learning · Computer Science 2020-07-23 Milad Nasr , Reza Shokri , Amir houmansadr

Data privacy is an important concern in machine learning, and is fundamentally at odds with the task of training useful learning models, which typically require the acquisition of large amounts of private user data. One possible way of…

Machine Learning · Computer Science 2019-02-14 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Large language models (LLMs) do not preserve privacy at inference-time. The LLM's outputs can inadvertently reveal information about the model's context, which presents a privacy challenge when the LLM is augmented via tools or databases…

Computation and Language · Computer Science 2026-02-03 Rushil Thareja , Preslav Nakov , Praneeth Vepakomma , Nils Lukas

Private machine learning involves addition of noise while training, resulting in lower accuracy. Intuitively, greater stability can imply greater privacy and improve this privacy-utility tradeoff. We study this role of stability in private…

Machine Learning · Computer Science 2020-06-26 Lauren Watson , Benedek Rozemberczki , Rik Sarkar

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

Machine Learning · Computer Science 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso

NLP models trained with differential privacy (DP) usually adopt the DP-SGD framework, and privacy guarantees are often reported in terms of the privacy budget $\epsilon$. However, $\epsilon$ does not have any intrinsic meaning, and it is…

Machine Learning · Computer Science 2025-03-19 Pedro Faustini , Natasha Fernandes , Annabelle McIver , Mark Dras

This study develops a novel framework for privacy-preserving data analytics, addressing the critical challenge of balancing data utility with privacy concerns. We introduce three sophisticated algorithms: a Noise-Infusion Technique tailored…

Cryptography and Security · Computer Science 2024-04-26 Zahir Alsulaimawi

Proper communication is key to the adoption and implementation of differential privacy (DP). However, a prior study found that laypeople did not understand the data perturbation processes of DP and how DP noise protects their sensitive…

Cryptography and Security · Computer Science 2022-02-22 Aiping Xiong , Chuhao Wu , Tianhao Wang , Robert W. Proctor , Jeremiah Blocki , Ninghui Li , Somesh Jha

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

This paper presents a framework for privacy-preserving verification of machine learning models, focusing on models trained on sensitive data. Integrating Local Differential Privacy (LDP) with model explanations from LIME and SHAP, our…

Machine Learning · Computer Science 2025-01-15 Wenbiao Li , Anisa Halimi , Xiaoqian Jiang , Jaideep Vaidya , Erman Ayday

We study model personalization under user-level differential privacy (DP) in the shared representation framework. In this problem, there are $n$ users whose data is statistically heterogeneous, and their optimal parameters share an unknown…

Machine Learning · Computer Science 2025-06-25 Conor Snedeker , Xinyu Zhou , Raef Bassily

Hyperparameter tuning is a common practice in the application of machine learning but is a typically ignored aspect in the literature on privacy-preserving machine learning due to its negative effect on the overall privacy parameter. In…

Machine Learning · Computer Science 2025-05-26 Youlong Ding , Xueyang Wu

Internet tracking technologies and wearable electronics provide a vast amount of data to machine learning algorithms. This stock of data stands to increase with the developments of the internet of things and cyber-physical systems. Clearly,…

Cryptography and Security · Computer Science 2016-08-11 Jeffrey Pawlick , Quanyan Zhu

In distributed networks, calculating the maximum element is a fundamental task in data analysis, known as the distributed maximum consensus problem. However, the sensitive nature of the data involved makes privacy protection essential.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wenrui Yu , Richard Heusdens , Jun Pang , Qiongxiu Li

Text embedding inversion attacks reconstruct original sentences from latent representations, posing severe privacy threats in collaborative inference and edge computing. We propose TextCrafter, an optimization-based adversarial perturbation…

Cryptography and Security · Computer Science 2026-01-23 Duoxun Tang , Xinhang Jiang , Jiajun Niu