English
Related papers

Related papers: Training generative models from privatized data

200 papers

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang

We study private synthetic data generation for query release, where the goal is to construct a sanitized version of a sensitive dataset, subject to differential privacy, that approximately preserves the answers to a large collection of…

Machine Learning · Computer Science 2021-12-10 Terrance Liu , Giuseppe Vietri , Zhiwei Steven Wu

Generative Adversarial Networks (GANs) are a popular formulation to train generative models for complex high dimensional data. The standard method for training GANs involves a gradient descent-ascent (GDA) procedure on a minimax…

Machine Learning · Computer Science 2023-05-30 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Power consumption data is very useful as it allows to optimize power grids, detect anomalies and prevent failures, on top of being useful for diverse research purposes. However, the use of power consumption data raises significant privacy…

Signal Processing · Electrical Eng. & Systems 2021-11-29 Ganesh Del Grosso , Georg Pichler , Pablo Piantanida

Graph Neural Networks (GNNs) have become a popular tool for learning on graphs, but their widespread use raises privacy concerns as graph data can contain personal or sensitive information. Differentially private GNN models have been…

Machine Learning · Computer Science 2023-10-24 Sina Sajadmanesh , Daniel Gatica-Perez

This paper introduces the first statistically consistent estimator of the optimal transport map between two probability distributions, based on neural networks. Building on theoretical and practical advances in the field of Lipschitz neural…

Machine Learning · Statistics 2022-02-17 Alberto González-Sanz , Lucas de Lara , Louis Béthune , Jean-Michel Loubes

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

In this article, we introduce a new mode for training Generative Adversarial Networks (GANs). Rather than minimizing the distance of evidence distribution $\tilde{p}(x)$ and the generative distribution $q(x)$, we minimize the distance of…

Machine Learning · Computer Science 2018-10-30 Jianlin Su

The instability of Generative Adversarial Network (GAN) training has frequently been attributed to gradient descent. Consequently, recent methods have aimed to tailor the models and training procedures to stabilise the discrete updates. In…

Quantization is a widely adopted technique for deep neural networks to reduce the memory and computational resources required. However, when quantized, most models would need a suitable calibration process to keep their performance intact,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Athanasios Masouris , Mansi Sharma , Adrian Boguszewski , Alexander Kozlov , Zhuo Wu , Raymond Lo

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex,…

Machine Learning · Computer Science 2021-04-06 Edgar A. Bernal

Tuning curves characterizing the response selectivities of biological neurons often exhibit large degrees of irregularity and diversity across neurons. Theoretical network models that feature heterogeneous cell populations or random…

Quantitative Methods · Quantitative Biology 2017-07-20 Takafumi Arakaki , G. Barello , Yashar Ahmadian

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor

While Generative Adversarial Networks (GANs) achieve spectacular results on unstructured data like images, there is still a gap on tabular data, data for which state of the art supervised learning still favours to a large extent decision…

Machine Learning · Computer Science 2022-02-14 Richard Nock , Mathieu Guillame-Bert

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

Machine Learning · Statistics 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang

In this paper, we propose generating artificial data that retain statistical properties of real data as the means of providing privacy with respect to the original dataset. We use generative adversarial network to draw privacy-preserving…

Machine Learning · Computer Science 2019-04-30 Aleksei Triastcyn , Boi Faltings

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Huaxia Wang , Chun-Nam Yu