English
Related papers

Related papers: Misclassification Rate and Privacy-Utility Trade-o…

200 papers

Graph Neural Networks (GNNs) have shown remarkable success in various graph-based learning tasks. However, recent studies have raised concerns about fairness and privacy issues in GNNs, highlighting the potential for biased or…

Machine Learning · Computer Science 2025-03-05 Bartlomiej Surma , Michael Backes , Yang Zhang

In this paper, an adjustment to the original differentially private stochastic gradient descent (DPSGD) algorithm for deep learning models is proposed. As a matter of motivation, to date, almost no state-of-the-art machine learning…

Machine Learning · Computer Science 2021-07-13 Mehdi Amian

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Differential privacy is becoming one gold standard for protecting the privacy of publicly shared data. It has been widely used in social science, data science, public health, information technology, and the U.S. decennial census.…

Cryptography and Security · Computer Science 2022-06-07 Xuan Bi , Xiaotong Shen

Modern deep learning techniques focus on extracting intricate information from data to achieve accurate predictions. However, the training datasets may be crowdsourced and include sensitive information, such as personal contact details,…

Machine Learning · Statistics 2026-02-10 Zhongjie Shi , Puyu Wang , Chenyang Zhang , Yuan Cao

Differential privacy (DP) is an essential technique for privacy-preserving. It was found that a large model trained for privacy preserving performs worse than a smaller model (e.g. ResNet50 performs worse than ResNet18). To better…

Machine Learning · Computer Science 2021-11-30 Yinchen Shen , Zhiguo Wang , Ruoyu Sun , Xiaojing Shen

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

Federated learning (FL) allows to train a massive amount of data privately due to its decentralized structure. Stochastic gradient descent (SGD) is commonly used for FL due to its good empirical performance, but sensitive user information…

Machine Learning · Computer Science 2021-02-10 Muah Kim , Onur Günlü , Rafael F. Schaefer

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

We study the sublinear space continual release model for edge-differentially private (DP) graph algorithms, with a focus on the densest subgraph problem (DSG) in the insertion-only setting. Our main result is the first continual release DSG…

Data Structures and Algorithms · Computer Science 2025-10-14 Felix Zhou

Publishing open graph data while preserving individual privacy remains challenging when data publishers and data users are distinct entities. Although differential privacy (DP) provides rigorous guarantees, most existing approaches enforce…

Machine Learning · Computer Science 2026-03-25 Muhao Guo , Jiaqi Wu , Yizheng Liao , Wenke Lee , Shengzhe Chen , Yang Weng

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

The hidden state threat model of differential privacy (DP) assumes that the adversary has access only to the final trained machine learning (ML) model, without seeing intermediate states during training. However, the current privacy…

Machine Learning · Computer Science 2025-05-27 Rob Romijnders , Antti Koskela

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

Differentially private stochastic gradient descent (DP-SGD) is the canonical approach to private deep learning. While the current privacy analysis of DP-SGD is known to be tight in some settings, several empirical results suggest that…

Machine Learning · Computer Science 2024-07-17 Anvith Thudi , Hengrui Jia , Casey Meehan , Ilia Shumailov , Nicolas Papernot

Differential privacy (DP) has arisen as the gold standard in protecting an individual's privacy in datasets by adding calibrated noise to each data sample. While the application to categorical data is straightforward, its usability in the…

Cryptography and Security · Computer Science 2022-08-01 Malte Tölle , Ullrich Köthe , Florian André , Benjamin Meder , Sandy Engelhardt

This paper addresses the problem of protecting network information from privacy system identification (SI) attacks when sharing cyber-physical system simulations. We model analyst observations of networked states as time-series outputs of a…

Cryptography and Security · Computer Science 2025-10-02 Andrew Campbell , Anna Scaglione , Hang Liu , Victor Elvira , Sean Peisert , Daniel Arnold

Differentially Private Stochastic Gradient Descent (DP-SGD) is a key method for applying privacy in the training of deep learning models. It applies isotropic Gaussian noise to gradients during training, which can perturb these gradients in…

Machine Learning · Computer Science 2023-11-28 Pedro Faustini , Natasha Fernandes , Shakila Tonni , Annabelle McIver , Mark Dras

The Graph Convolutional Networks (GCNs) have achieved excellent results in node classification tasks, but the model's performance at low label rates is still unsatisfactory. Previous studies in Semi-Supervised Learning (SSL) for graph have…

Machine Learning · Computer Science 2023-11-30 Shuhao Shi , Jian Chen , Kai Qiao , Shuai Yang , Linyuan Wang , Bin Yan