English
Related papers

Related papers: Have it your way: Individualized Privacy Assignmen…

200 papers

Neural machine translation (NMT) is a widely popular text generation task, yet there is a considerable research gap in the development of privacy-preserving NMT models, despite significant data privacy concerns for NMT systems.…

Computation and Language · Computer Science 2024-04-25 Timour Igamberdiev , Doan Nam Long Vu , Felix Künnecke , Zhuo Yu , Jannik Holmer , Ivan Habernal

Differentially private stochastic gradient descent (DP-SGD) has been widely adopted in deep learning to provide rigorously defined privacy, which requires gradient clipping to bound the maximum norm of individual gradients and additive…

Machine Learning · Computer Science 2023-06-29 Junyi Zhu , Matthew B. Blaschko

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

Nowadays, owners and developers of deep learning models must consider stringent privacy-preservation rules of their training data, usually crowd-sourced and retaining sensitive information. The most widely adopted method to enforce privacy…

Machine Learning · Computer Science 2022-09-08 Eugenio Lomurno , Matteo matteucci

While location trajectories offer valuable insights, they also reveal sensitive personal information. Differential Privacy (DP) offers formal protection, but achieving a favourable utility-privacy trade-off remains challenging. Recent works…

Cryptography and Security · Computer Science 2025-06-12 Erik Buchholz , Natasha Fernandes , David D. Nguyen , Alsharif Abuadbba , Surya Nepal , Salil S. Kanhere

Nowadays, differential privacy (DP) has become a well-accepted standard for privacy protection, and deep neural networks (DNN) have been immensely successful in machine learning. The combination of these two techniques, i.e., deep learning…

Cryptography and Security · Computer Science 2024-08-02 Jianxin Wei , Ergute Bao , Xiaokui Xiao , Yin Yang

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

In the domain of deep learning, the challenge of protecting sensitive data while maintaining model utility is significant. Traditional Differential Privacy (DP) techniques such as Differentially Private Stochastic Gradient Descent (DP-SGD)…

Machine Learning · Computer Science 2024-11-06 Tao Huang , Qingyu Huang , Xin Shi , Jiayang Meng , Guolong Zheng , Xu Yang , Xun Yi

Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use…

Cryptography and Security · Computer Science 2025-06-25 Saeed Mahloujifar , Chuan Guo , G. Edward Suh , Kamalika Chaudhuri

Differential Privacy (DP) is a widely adopted standard for privacy-preserving data analysis, but it assumes a uniform privacy budget across all records, limiting its applicability when privacy requirements vary with data values. Per-record…

Databases · Computer Science 2025-11-25 Xinghe Chen , Dajun Sun , Quanqing Xu , Wei Dong

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

The rise of IoT devices has prompted the demand for deploying machine learning at-the-edge with real-time, efficient, and secure data processing. In this context, implementing machine learning (ML) models with real-valued weight parameters…

Machine Learning · Computer Science 2024-02-12 Ce Feng , Parv Venkitasubramaniam

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

Algorithms such as Differentially Private SGD enable training machine learning models with formal privacy guarantees. However, there is a discrepancy between the protection that such algorithms guarantee in theory and the protection they…

Differentially Private Stochastic Gradient Descent (DP-SGD) is a popular iterative algorithm used to train machine learning models while formally guaranteeing the privacy of users. However, the privacy analysis of DP-SGD makes the…

Machine Learning · Computer Science 2024-10-31 Meenatchi Sundaram Muthu Selva Annamalai

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia

While pursuing better utility by discovering knowledge from the data, individual's privacy may be compromised during an analysis. To that end, differential privacy has been widely recognized as the state-of-the-art privacy notion. By…

Cryptography and Security · Computer Science 2022-09-07 Meisam Mohammady