English
Related papers

Related papers: Training Differentially Private Graph Neural Netwo…

200 papers

Graph Neural Networks (GNNs) have emerged as powerful models for learning from graph-structured data. However, their widespread adoption has raised serious privacy concerns. While prior research has primarily focused on edge-level privacy,…

Machine Learning · Computer Science 2025-11-12 Jie Fu , Yuan Hong , Zhili Chen , Wendy Hui Wang

Differentially private analysis of graphs is widely used for releasing statistics from sensitive graphs while still preserving user privacy. Most existing algorithms however are in a centralized privacy model, where a trusted data curator…

Cryptography and Security · Computer Science 2021-02-12 Jacob Imola , Takao Murakami , Kamalika Chaudhuri

Differentially private stochastic gradient descent (DP-SGD) is broadly considered to be the gold standard for training and fine-tuning neural networks under differential privacy (DP). With the increasing availability of high-quality…

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

Differentially private (DP) transfer learning, i.e., fine-tuning a pretrained model on private data, is the current state-of-the-art approach for training large models under privacy constraints. We focus on two key hyperparameters in this…

Machine Learning · Computer Science 2026-04-20 Aki Rehn , Linzh Zhao , Mikko A. Heikkilä , Antti Honkela

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

We consider the problem of learning Markov Random Fields (including the prototypical example, the Ising model) under the constraint of differential privacy. Our learning goals include both structure learning, where we try to estimate the…

Data Structures and Algorithms · Computer Science 2020-08-17 Huanyu Zhang , Gautam Kamath , Janardhan Kulkarni , Zhiwei Steven Wu

Over the last decade, signal processing on graphs has become a very active area of research. Specifically, the number of applications, for instance in statistical or deep learning, using frames built from graphs, such as wavelets on graphs,…

Signal Processing · Electrical Eng. & Systems 2023-03-08 Elie Chedemail , Basile de Loynes , Fabien Navarro , Baptiste Olivier

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

Machine Learning · Computer Science 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic

Dynamic graph neural networks (DGNNs) have emerged and been widely deployed in various web applications (e.g., Reddit) to serve users (e.g., personalized content delivery) due to their remarkable ability to learn from complex and dynamic…

Machine Learning · Computer Science 2025-02-04 He Zhang , Bang Wu , Xiangwen Yang , Xingliang Yuan , Xiaoning Liu , Xun Yi

Privacy and interpretability are two important ingredients for achieving trustworthy machine learning. We study the interplay of these two aspects in graph machine learning through graph reconstruction attacks. The goal of the adversary…

Machine Learning · Computer Science 2023-11-03 Iyiola E. Olatunji , Mandeep Rathee , Thorben Funke , Megha Khosla

Developing machine learning methods that are privacy preserving is today a central topic of research, with huge practical impacts. Among the numerous ways to address privacy-preserving learning, we here take the perspective of computing the…

Machine Learning · Computer Science 2021-07-06 Alain Rakotomamonjy , Liva Ralaivola

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad

Although machine learning models trained on massive data have led to break-throughs in several areas, their deployment in privacy-sensitive domains remains limited due to restricted access to data. Generative models trained with privacy…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Alex Bie , Arash Vahdat , Sanja Fidler , Karsten Kreis

State-of-the-art approaches for training Differentially Private (DP) Deep Neural Networks (DNN) face difficulties to estimate tight bounds on the sensitivity of the network's layers, and instead rely on a process of per-sample gradient…

Differential privacy (DP) is a gold-standard concept of measuring and guaranteeing privacy in data analysis. It is well-known that the cost of adding DP to deep learning model is its accuracy. However, it remains unclear how it affects…

Machine Learning · Computer Science 2021-08-26 Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

Modern machine learning techniques are successfully being adapted to data modeled as graphs. However, many real-world graphs are typically very large and do not fit in memory, often making the problem of training machine learning models on…

Machine Learning · Computer Science 2020-12-10 Alexandra Angerd , Keshav Balasubramanian , Murali Annavaram

Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used to protect training data in machine learning. Its privacy guarantee is commonly analyzed through a security game in which an adversary infers whether a target record…

Cryptography and Security · Computer Science 2026-05-18 Wenhao Wang , Shujie Cui , Hui Cui , Xingliang Yuan

We explore the training of generative adversarial networks with differential privacy to anonymize image data sets. On MNIST, we numerically measure the privacy-utility trade-off using parameters from $\epsilon$-$\delta$ differential privacy…

Machine Learning · Computer Science 2020-05-07 Justus T. C. Schwabedal , Pascal Michel , Mario S. Riontino