English
Related papers

Related papers: Sparsity Aware Normalization for GANs

200 papers

Convolutional neural networks (CNNs) have achieved beyond human-level accuracy in the image classification task and are widely deployed in real-world environments. However, CNNs show vulnerability to adversarial perturbations that are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Desheng Wang , Weidong Jin , Yunpu Wu , Aamir Khan

Spectral normalization (SN) is a widely-used technique for improving the stability and sample quality of Generative Adversarial Networks (GANs). However, there is currently limited understanding of why SN is effective. In this work, we show…

Machine Learning · Computer Science 2021-04-09 Zinan Lin , Vyas Sekar , Giulia Fanti

Generative adversarial networks (GANs) and normalizing flows are both approaches to density estimation that use deep neural networks to transform samples from an uninformative prior distribution to an approximation of the data distribution.…

Machine Learning · Computer Science 2021-12-15 Tianci Liu , Jeffrey Regier

Deep artificial neural networks achieve surprising generalization abilities that remain poorly understood. In this paper, we present a new approach to analyzing generalization for deep feed-forward ReLU networks that takes advantage of the…

Machine Learning · Computer Science 2023-07-06 Ramchandran Muthukumar , Jeremias Sulam

A conditional general adversarial network (GAN) is proposed for image deblurring problem. It is tailored for image deblurring instead of just applying GAN on the deblurring problem. Motivated by that, dark channel prior is carefully picked…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Shuang Zhang , Ada Zhen , Robert L. Stevenson

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Egor Sevriugov , Ivan Oseledets

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

In recent years, neural network approaches have been widely adopted for machine learning tasks, with applications in computer vision. More recently, unsupervised generative models based on neural networks have been successfully applied to…

Machine Learning · Computer Science 2018-02-06 Maya Kabkab , Pouya Samangouei , Rama Chellappa

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

Machine Learning · Computer Science 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

The brain, as the source of inspiration for Artificial Neural Networks (ANN), is based on a sparse structure. This sparse structure helps the brain to consume less energy, learn easier and generalize patterns better than any other ANN. In…

Machine Learning · Computer Science 2021-03-16 Seyed Majid Naji , Azra Abtahi , Farokh Marvasti

Generative Adversarial Networks can learn the mapping of random noise to realistic images in a semi-supervised framework. This mapping ability can be used for semi-supervised image classification to detect images of an unknown class where…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Saman Motamed , Farzad Khalvati

Single image super-resolution (SISR) has played an important role in the field of image processing. Recent generative adversarial networks (GANs) can achieve excellent results on low-resolution images. However, there are little literatures…

Image and Video Processing · Electrical Eng. & Systems 2026-01-14 Ziang Wu , Xuanyu Zhang , Yinbo Yu , Qi Zhu , Jerry Chun-Wei Lin , Chunwei Tian

With the development of convolutional neural network, deep learning has shown its success for retinal disease detection from optical coherence tomography (OCT) images. However, deep learning often relies on large scale labelled data for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Kang Zhou , Shenghua Gao , Jun Cheng , Zaiwang Gu , Huazhu Fu , Zhi Tu , Jianlong Yang , Yitian Zhao , Jiang Liu

Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xijun Wang , Santiago López-Tapia , Alice Lucas , Xinyi Wu , Rafael Molina , Aggelos K. Katsaggelos

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

Machine Learning · Computer Science 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

Generative Adversarial Networks (GANs), though powerful, is hard to train. Several recent works (brock2016neural,miyato2018spectral) suggest that controlling the spectra of weight matrices in the discriminator can significantly improve the…

Machine Learning · Computer Science 2019-03-05 Haoming Jiang , Zhehui Chen , Minshuo Chen , Feng Liu , Dingding Wang , Tuo Zhao

In this paper, we propose a novel normalization method called penalty gradient normalization (PGN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike existing work such as…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Tian Xia

Generative Adversarial Networks (GANs) have become a very popular tool for implicitly learning high-dimensional probability distributions. Several improvements have been made to the original GAN formulation to address some of its…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Parimala Kancharla , Sumohana S. Channappayya

Generative Adversarial Networks (GANs) are popular and successful generative models. Despite their success, optimization is notoriously challenging. In this work, we explain the success and limitations of GANs by casting them as Bayesian…

Machine Learning · Computer Science 2026-02-03 Maurizio Filippone , Marius P. Linhard