English
Related papers

Related papers: Generalization in Generative Adversarial Networks:…

200 papers

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Simon Jenni , Paolo Favaro

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

The proliferation of big data has brought an urgent demand for privacy-preserving data publishing. Traditional solutions to this demand have limitations on effectively balancing the tradeoff between privacy and utility of the released data.…

Databases · Computer Science 2020-08-31 Ju Fan , Tongyu Liu , Guoliang Li , Junyou Chen , Yuwei Shen , Xiaoyong Du

An attack on deep learning systems where intelligent machines collaborate to solve problems could cause a node in the network to make a mistake on a critical judgment. At the same time, the security and privacy concerns of AI have…

Machine Learning · Computer Science 2021-08-03 Yuwei Sun , Ng Chong , Hideya Ochiai

Generative adversarial networks (GANs) have been shown to provide an effective way to model complex distributions and have obtained impressive results on various challenging tasks. However, typical GANs require fully-observed data during…

Machine Learning · Computer Science 2019-02-27 Steven Cheng-Xian Li , Bo Jiang , Benjamin Marlin

Deep generative models have gained much attention given their ability to generate data for applications as varied as healthcare to financial technology to surveillance, and many more - the most popular models being generative adversarial…

Cryptography and Security · Computer Science 2021-12-02 Hui Sun , Tianqing Zhu , Zhiqiu Zhang , Dawei Jin. Ping Xiong , Wanlei Zhou

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

Computation and Language · Computer Science 2022-11-18 Sajad Movahedi , Azadeh Shakery

We study the generalization error of stochastic learning algorithms from an information-theoretic perspective, with a particular emphasis on deriving sharper bounds for differentially private algorithms. It is well known that the…

Information Theory · Computer Science 2026-04-20 Yanxiao Liu , Chun Hei Michael Shiu , Lele Wang , Deniz Gündüz

Generative adversarial training can be generally understood as minimizing certain moment matching loss defined by a set of discriminator functions, typically neural networks. The discriminator set should be large enough to be able to…

Machine Learning · Computer Science 2018-02-27 Pengchuan Zhang , Qiang Liu , Dengyong Zhou , Tao Xu , Xiaodong He

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

Machine Learning · Computer Science 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier

An open secret in contemporary machine learning is that many models work beautifully on standard benchmarks but fail to generalize outside the lab. This has been attributed to biased training data, which provide poor coverage over real…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ali Jahanian , Lucy Chai , Phillip Isola

The remarkable success of machine learning, especially deep learning, has produced a variety of cloud-based services for mobile users. Such services require an end user to send data to the service provider, which presents a serious…

Machine Learning · Computer Science 2019-01-28 Sicong Liu , Anshumali Shrivastava , Junzhao Du , Lin Zhong

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

Machine Learning · Statistics 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Recently the Generative Adversarial Network has become a hot topic. Considering the application of GAN in multi-user environment, we propose Distributed-GAN. It enables multiple users to train with their own data locally and generates more…

Machine Learning · Computer Science 2019-11-20 Xiaoyu Wang , Ye Deng , Jinjun Wang

Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator…

Machine Learning · Computer Science 2021-02-10 Yikai Zhang , Hui Qu , Qi Chang , Huidong Liu , Dimitris Metaxas , Chao Chen

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor

Generative adversarial networks (GANs) are able to generate high resolution photo-realistic images of objects that "do not exist." These synthetic images are rather difficult to detect as fake. However, the manner in which these generative…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Patrick Tinsley , Adam Czajka , Patrick Flynn

Generative Adversarial Networks (GAN) have greatly influenced the development of computer vision and artificial intelligence in the past decade and also connected art and machine intelligence together. This book begins with a detailed…