English
Related papers

Related papers: Training Differentially Private Graph Neural Netwo…

200 papers

We study differential privacy (DP) in a multi-party setting where each party only trusts a (known) subset of the other parties with its data. Specifically, given a trust graph where vertices correspond to parties and neighbors are mutually…

Cryptography and Security · Computer Science 2024-10-17 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Serena Wang

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

Classically, ML models trained with stochastic gradient descent (SGD) are designed to minimize the average loss per example and use a distribution of training examples that remains {\em static} in the course of training. Research in recent…

Machine Learning · Computer Science 2020-06-02 Eliav Buchnik , Edith Cohen

Many forms of sensitive data, such as web traffic, mobility data, or hospital occupancy, are inherently sequential. The standard method for training machine learning models while ensuring privacy for units of sensitive information, such as…

Graph data, such as chemical networks and social networks, may be deemed confidential/private because the data owner often spends lots of resources collecting the data or the data contains sensitive information, e.g., social relationships.…

Cryptography and Security · Computer Science 2020-10-07 Xinlei He , Jinyuan Jia , Michael Backes , Neil Zhenqiang Gong , Yang Zhang

Training machine learning models with differential privacy (DP) has received increasing interest in recent years. One of the most popular algorithms for training differentially private models is differentially private stochastic gradient…

Machine Learning · Computer Science 2024-02-21 Ziteng Sun , Ananda Theertha Suresh , Aditya Krishna Menon

This paper presents a holistic approach to gradient leakage resilient distributed Stochastic Gradient Descent (SGD). First, we analyze two types of strategies for privacy-enhanced federated learning: (i) gradient pruning with random…

Machine Learning · Computer Science 2023-05-12 Wenqi Wei , Ling Liu , Jingya Zhou , Ka-Ho Chow , Yanzhao Wu

In the domain of deep learning, the challenge of protecting sensitive data while maintaining model utility is significant. Traditional Differential Privacy (DP) techniques such as Differentially Private Stochastic Gradient Descent (DP-SGD)…

Machine Learning · Computer Science 2024-11-06 Tao Huang , Qingyu Huang , Xin Shi , Jiayang Meng , Guolong Zheng , Xu Yang , Xun Yi

Graph neural networks (GNNs) achieve strong performance on relational data, but real-world graphs are often distributed across organizations that cannot share raw data due to privacy and policy constraints. Existing federated GNN methods…

Machine Learning · Computer Science 2026-05-27 Zhishuai Guo , Wenhan Wu , Chen Chen , Lei Zhang , Olivera Kotevska , Ravi K Madduri

Privacy-preserving deep learning is crucial for deploying deep neural network based solutions, especially when the model works on data that contains sensitive information. Most privacy-preserving methods lead to undesirable performance…

Cryptography and Security · Computer Science 2019-09-19 Lichao Sun , Yingbo Zhou , Ji Wang , Jia Li , Richard Sochar , Philip S. Yu , Caiming Xiong

Differentially private machine learning trains models while protecting privacy of the sensitive training data. The key to obtain differentially private models is to introduce noise/randomness to the training process. In particular, existing…

Cryptography and Security · Computer Science 2020-08-25 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

Federated graph learning (FGL) has recently emerged as a promising privacy-preserving paradigm that enables distributed graph learning across multiple data owners. A critical privacy concern in federated learning is whether an adversary can…

Machine Learning · Computer Science 2026-01-28 Shuyue Wei , Wantong Chen , Tongyu Wei , Chen Gong , Yongxin Tong , Lizhen Cui

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

Differentially private learning is essential for training models on sensitive data, but empirical studies consistently show that it can degrade performance, introduce fairness issues like disparate impact, and reduce adversarial robustness.…

Machine Learning · Computer Science 2026-04-21 Ruichen Xu , Kexin Chen

Graph neural networks (GNNs) are susceptible to privacy inference attacks (PIAs), given their ability to learn joint representation from features and edges among nodes in graph data. To prevent privacy leakages in GNNs, we propose a novel…

Machine Learning · Computer Science 2022-11-11 Khang Tran , Phung Lai , NhatHai Phan , Issa Khalil , Yao Ma , Abdallah Khreishah , My Thai , Xintao Wu

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

Safeguarding privacy in sensitive training data is paramount, particularly in the context of generative modeling. This can be achieved through either differentially private stochastic gradient descent or a differentially private metric for…