English
Related papers

Related papers: Improving Generative Adversarial Networks with Sel…

200 papers

We show that the canonical approach for training differentially private GANs -- updating the discriminator with differentially private stochastic gradient descent (DPSGD) -- can yield significantly improved results after modifications to…

Machine Learning · Computer Science 2023-10-06 Alex Bie , Gautam Kamath , Guojun Zhang

Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs.…

Machine Learning · Computer Science 2023-12-29 Liang Hou , Qi Cao , Yige Yuan , Songtao Zhao , Chongyang Ma , Siyuan Pan , Pengfei Wan , Zhongyuan Wang , Huawei Shen , Xueqi Cheng

Generative Adversarial Networks (GANs) have witnessed prevailing success in yielding outstanding images, however, they are burdensome to deploy on resource-constrained devices due to ponderous computational costs and hulking memory usage.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Yuxi Ren , Jie Wu , Xuefeng Xiao , Jianchao Yang

Generative adversarial networks (GANs) are challenging to train stably, and a promising remedy of injecting instance noise into the discriminator input has not been very effective in practice. In this paper, we propose Diffusion-GAN, a…

Machine Learning · Computer Science 2023-08-29 Zhendong Wang , Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Generative adversarial networks, or GANs, commonly display unstable behavior during training. In this work, we develop a principled theoretical framework for understanding the stability of various types of GANs. In particular, we derive…

Machine Learning · Computer Science 2020-02-12 Casey Chu , Kentaro Minami , Kenji Fukumizu

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

Machine Learning · Computer Science 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun

With the recent development of deep learning on steganalysis, embedding secret information into digital images faces great challenges. In this paper, a secure steganography algorithm by using adversarial training is proposed. The…

Multimedia · Computer Science 2018-04-24 Jianhua Yang , Kai Liu , Xiangui Kang , Edward K. Wong , Yun-Qing Shi

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

Machine Learning · Computer Science 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

Generative Adversarial Networks (GANs) are proficient at generating synthetic data but continue to suffer from mode collapse, where the generator produces a narrow range of outputs that fool the discriminator but fail to capture the full…

Machine Learning · Computer Science 2025-11-03 Mahsa Valizadeh , Rui Tuo , James Caverlee

Recent improvements in generative adversarial visual synthesis incorporate real and fake image transformation in a self-supervised setting, leading to increased stability and perceptual fidelity. However, these approaches typically involve…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Neel Dey , Antong Chen , Soheil Ghafurian

We propose a new GAN-based unsupervised model for disentangled representation learning. The new model is discovered in an attempt to utilize the Information Bottleneck (IB) framework to the optimization of GAN, thereby named IB-GAN. The…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Insu Jeon , Wonkwang Lee , Myeongjang Pyeon , Gunhee Kim

Thanks to their remarkable generative capabilities, GANs have gained great popularity, and are used abundantly in state-of-the-art methods and applications. In a GAN based model, a discriminator is trained to learn the real data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Firas Shama , Roey Mechrez , Alon Shoshan , Lihi Zelnik-Manor

Generative Adversarial Networks (GANs) coupled with self-supervised tasks have shown promising results in unconditional and semi-supervised image generation. We propose a self-supervised approach (LT-GAN) to improve the generation quality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Parth Patel , Nupur Kumari , Mayank Singh , Balaji Krishnamurthy

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Generative Adversarial Networks (GANs) have become the most used networks towards solving the problem of image generation. Self-supervised GANs are later proposed to avoid the catastrophic forgetting of the discriminator and to improve the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Gulcin Baykal , Furkan Ozcelik , Gozde Unal

Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theoretical justification, in contrast to alternatives such as…

Machine Learning · Computer Science 2020-10-19 Matt Shannon , Ben Poole , Soroosh Mariooryad , Tom Bagby , Eric Battenberg , David Kao , Daisy Stanton , RJ Skerry-Ryan

In terms of Generative Adversarial Networks (GANs), the information metric to discriminate the generative data from the real data, lies in the key point of generation efficiency, which plays an important role in GAN-based applications,…

Machine Learning · Computer Science 2021-01-08 Rui She , Pingyi Fan

The landscape of fake media creation changed with the introduction of Generative Adversarial Networks (GAN s). Fake media creation has been on the rise with the rapid advances in generation technology, leading to new challenges in Detecting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Sowdagar Mahammad Shahid , Sudev Kumar Padhi , Umesh Kashyap , Sk. Subidh Ali

Deep learning algorithms have been shown to perform extremely well on many classical machine learning problems. However, recent studies have shown that deep learning, like other machine learning techniques, is vulnerable to adversarial…

Cryptography and Security · Computer Science 2016-03-15 Nicolas Papernot , Patrick McDaniel , Xi Wu , Somesh Jha , Ananthram Swami

Despite the success of generative adversarial networks (GANs) for image generation, the trade-off between visual quality and image diversity remains a significant issue. This paper achieves both aims simultaneously by improving the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Duhyeon Bang , Hyunjung Shim