English
Related papers

Related papers: Differentially Private Generation of Small Images

200 papers

Training large neural networks with meaningful/usable differential privacy security guarantees is a demanding challenge. In this paper, we tackle this problem by revisiting the two key operations in Differentially Private Stochastic…

Machine Learning · Computer Science 2022-10-11 Hanshen Xiao , Jun Wan , Srinivas Devadas

Directed graphical models (DGMs) are a class of probabilistic models that are widely used for predictive analysis in sensitive domains, such as medical diagnostics. In this paper we present an algorithm for differentially private learning…

Machine Learning · Computer Science 2020-07-14 Amrita Roy Chowdhury , Theodoros Rekatsinas , Somesh Jha

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

Machine Learning · Computer Science 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

We initiate an empirical investigation into differentially private graph neural networks on population graphs from the medical domain by examining privacy-utility trade-offs at different privacy levels on both real-world and synthetic…

Machine Learning · Computer Science 2023-07-14 Tamara T. Mueller , Maulik Chevli , Ameya Daigavane , Daniel Rueckert , Georgios Kaissis

With increasing usage of deep learning algorithms in many application, new research questions related to privacy and adversarial attacks are emerging. However, the deep learning algorithm improvement needs more and more data to be shared…

Machine Learning · Computer Science 2020-04-29 Amit Chaulwar

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Data privacy is an important concern in machine learning, and is fundamentally at odds with the task of training useful learning models, which typically require the acquisition of large amounts of private user data. One possible way of…

Machine Learning · Computer Science 2019-02-14 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

In this paper, we apply machine learning to distributed private data owned by multiple data owners, entities with access to non-overlapping training datasets. We use noisy, differentially-private gradients to minimize the fitness cost of…

Cryptography and Security · Computer Science 2019-07-03 Nan Wu , Farhad Farokhi , David Smith , Mohamed Ali Kaafar

Machine learning with formal privacy-preserving techniques like Differential Privacy (DP) allows one to derive valuable insights from sensitive medical imaging data while promising to protect patient privacy, but it usually comes at a sharp…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Florian A. Hölzl , Daniel Rueckert , Georgios Kaissis

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

A major challenge in applying differential privacy to training deep neural network models is scalability.The widely-used training algorithm, differentially private stochastic gradient descent (DP-SGD), struggles with training…

Machine Learning · Computer Science 2023-03-09 Kamil Adamczewski , Mijung Park

Generative AI offers transformative potential for high-stakes domains such as healthcare and finance, yet privacy and regulatory barriers hinder the use of real-world data. To address this, differentially private synthetic data generation…

Training deep learning models with differential privacy (DP) results in a degradation of performance. The training dynamics of models with DP show a significant difference from standard training, whereas understanding the geometric…

Machine Learning · Computer Science 2023-06-12 Jinseong Park , Hoki Kim , Yujin Choi , Jaewook Lee

Synthetic data has been hailed as the silver bullet for privacy preserving data analysis. If a record is not real, then how could it violate a person's privacy? In addition, deep-learning based generative models are employed successfully to…

Machine Learning · Computer Science 2023-07-14 Benedikt Groß , Gerhard Wunder

Distributed online learning has been proven extremely effective in solving large-scale machine learning problems over streaming data. However, information sharing between learners in distributed learning also raises concerns about the…

Machine Learning · Computer Science 2023-10-31 Ziqin Chen , Yongqiang Wang

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

The superior performance of large foundation models relies on the use of massive amounts of high-quality data, which often contain sensitive, private and copyrighted material that requires formal protection. While differential privacy (DP)…

Machine Learning · Computer Science 2024-10-30 Zhiqi Bu , Xinwei Zhang , Mingyi Hong , Sheng Zha , George Karypis

Recent advances in score-based generative models have led to a huge spike in the development of downstream applications using generative models ranging from data augmentation over image and video generation to anomaly detection. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mischa Dombrowski , Bernhard Kainz

Machine learning models have shone in a variety of domains and attracted increasing attention from both the security and the privacy communities. One important yet worrying question is: Will training models under the differential privacy…

Machine Learning · Computer Science 2023-11-22 Yuan Zhang , Zhiqi Bu