English
Related papers

Related papers: High Epsilon Synthetic Data Vulnerabilities in MST…

200 papers

Differentially Private Stochastic Gradient Descent (DP-SGD) is the dominant paradigm for private training, but its fundamental limitations under worst-case adversarial privacy definitions remain poorly understood. We analyze DP-SGD in the…

Machine Learning · Computer Science 2026-04-17 Murat Bilgehan Ertan , Marten van Dijk

When sharing data among researchers or releasing data for public use, there is a risk of exposing sensitive information of individuals in the data set. Data synthesis (DS) is a statistical disclosure limitation technique for releasing…

Methodology · Statistics 2020-07-01 Claire McKay Bowen , Fang Liu

In this manuscript, we provide a set of tools (in terms of semidefinite programs) to synthesize Gaussian mechanisms to maximize privacy of databases. Information about the database is disclosed through queries requested by (potentially)…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

Differentially Private Stochastic Gradient Descent (DP-SGD) is a popular iterative algorithm used to train machine learning models while formally guaranteeing the privacy of users. However, the privacy analysis of DP-SGD makes the…

Machine Learning · Computer Science 2024-10-31 Meenatchi Sundaram Muthu Selva Annamalai

Differential Privacy (DP) formalizes privacy in mathematical terms and provides a robust concept for privacy protection. DIfferentially Private Data Synthesis (DIPS) techniques produce and release synthetic individual-level data in the DP…

Applications · Statistics 2020-10-22 Claire McKay Bowen , Fang Liu , Binyue Su

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

Introducing noise in the training of machine learning systems is a powerful way to protect individual privacy via differential privacy guarantees, but comes at a cost to utility. This work looks at whether the inherent randomness of…

Machine Learning · Computer Science 2022-03-01 Stephanie L. Hyland , Shruti Tople

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

Training machine learning models based on neural networks requires large datasets, which may contain sensitive information. The models, however, should not expose private information from these datasets. Differentially private SGD [DP-SGD]…

Machine Learning · Computer Science 2024-09-26 Francisco Aguilera-Martínez , Fernando Berzal

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum

Institutions collect massive learning traces but they may not disclose it for privacy issues. Synthetic data generation opens new opportunities for research in education. In this paper we present a generative model for educational data that…

Computers and Society · Computer Science 2022-07-09 Jill-Jênn Vie , Tomas Rigaux , Sein Minn

Artificial intelligence (AI) has the potential to transform healthcare, but it requires access to health data. Synthetic data that is generated through machine learning models trained on real data, offers a way to share data while…

Computers and Society · Computer Science 2025-08-13 Vibeke Binz Vallevik , Anne Kjersti C. Befring , Severin Elvatun , Jan Franz Nygaard

Background: Heart failure (HF) research is constrained by limited access to large, shareable datasets due to privacy regulations and institutional barriers. Synthetic data generation offers a promising solution to overcome these challenges…

The interplay between optimization and privacy has become a central theme in privacy-preserving machine learning. Noisy stochastic gradient descent (SGD) has emerged as a cornerstone algorithm, particularly in large-scale settings. These…

Machine Learning · Computer Science 2025-10-21 Shurong Lin , Eric D. Kolaczyk , Adam Smith , Elliot Paquette

Programmatically generated synthetic data has been used in differential private training for classification to enhance performance without privacy leakage. However, as the synthetic data is generated from a random process, the distribution…

Machine Learning · Computer Science 2024-12-16 Yujin Choi , Jinseong Park , Junyoung Byun , Jaewook Lee

Large language models (LLMs) have presented outstanding performance in code generation and completion. However, fine-tuning these models on private datasets can raise privacy and proprietary concerns, such as the leakage of sensitive…

Cryptography and Security · Computer Science 2026-01-16 Zheng Liu , Chen Gong , Terry Yue Zhuo , Kecen Li , Weichen Yu , Matt Fredrikson , Tianhao Wang

While power systems research relies on the availability of real-world network datasets, data owners (e.g., system operators) are hesitant to share data due to security and privacy risks. To control these risks, we develop privacy-preserving…

Cryptography and Security · Computer Science 2023-03-21 Vladimir Dvorkin , Audun Botterud

The Synthetic Minority Over-sampling Technique (SMOTE) is one of the most widely used methods for addressing class imbalance and generating synthetic data. Despite its popularity, little attention has been paid to its privacy implications;…

Cryptography and Security · Computer Science 2026-03-03 Georgi Ganev , Reza Nazari , Rees Davison , Amir Dizche , Xinmin Wu , Ralph Abbey , Jorge Silva , Emiliano De Cristofaro

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu