English
Related papers

Related papers: Spectral Regularization for Combating Mode Collaps…

200 papers

Deep long-tailed learning aims to train useful deep networks on practical, real-world imbalanced distributions, wherein most labels of the tail classes are associated with a few samples. There has been a large body of work to train…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Harsh Rangwani , Naman Jaswani , Tejan Karmali , Varun Jampani , R. Venkatesh Babu

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

Generative adversarial networks (GANs) are known to benefit from regularization or normalization of their critic (discriminator) network during training. In this paper, we analyze the popular spectral normalization scheme, find a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Idan Kligvasser , Tomer Michaeli

Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training…

Disordered Systems and Neural Networks · Physics 2022-12-12 Steven Durr , Youssef Mroueh , Yuhai Tu , Shenshen Wang

We propose studying GAN training dynamics as regret minimization, which is in contrast to the popular view that there is consistent minimization of a divergence between real and generated distributions. We analyze the convergence of GAN…

Artificial Intelligence · Computer Science 2017-12-12 Naveen Kodali , Jacob Abernethy , James Hays , Zsolt Kira

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv

Generative Adversarial Networks (GANs) have been widely applied in different scenarios thanks to the development of deep neural networks. The original GAN was proposed based on the non-parametric assumption of the infinite capacity of…

Machine Learning · Computer Science 2022-11-04 Ziqiang Li , Muhammad Usman , Rentuo Tao , Pengfei Xia , Chaoyue Wang , Huanhuan Chen , Bin Li

Generative Adversarial Networks (GANs) are a class of generative models used for various applications, but they have been known to suffer from the mode collapse problem, in which some modes of the target distribution are ignored by the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Karttikeya Mangalam , Rohin Garg

Generative adversarial networks (GANs) have recently become a popular data augmentation technique used by machine learning practitioners. However, they have been shown to suffer from the so-called mode collapse failure mode, which makes…

Machine Learning · Computer Science 2023-08-29 Denis Liu

In conditional Generative Adversarial Networks (cGANs), when two different initial noises are concatenated with the same conditional information, the distance between their outputs is relatively smaller, which makes minor modes likely to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Mengxiao Hu , Jinlong Li , Maolin Hu , Tao Hu

One of the frontier issues that severely hamper the development of automatic snore sound classification (ASSC) associates to the lack of sufficient supervised training data. To cope with this problem, we propose a novel data augmentation…

Machine Learning · Computer Science 2019-04-01 Zixing Zhang , Jing Han , Kun Qian , Christoph Janott , Yanan Guo , Bjoern Schuller

We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Deep learning methods are state-of-the-art for spectral image (SI) computational tasks. However, these methods are constrained in their performance since available datasets are limited due to the highly expensive and long acquisition time.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Emmanuel Martinez , Roman Jacome , Alejandra Hernandez-Rojas , Henry Arguello

Natural images can be regarded as residing in a manifold that is embedded in a higher dimensional Euclidean space. Generative Adversarial Networks (GANs) try to learn the distribution of the real images in the manifold to generate samples…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Sheng Zhong , Shifu Zhou

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously…

Machine Learning · Computer Science 2019-05-15 Karol Kurach , Mario Lucic , Xiaohua Zhai , Marcin Michalski , Sylvain Gelly

In this paper, we propose a novel normalization method called gradient normalization (GN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike existing work such as gradient…

Machine Learning · Computer Science 2021-10-12 Yi-Lun Wu , Hong-Han Shuai , Zhi-Rui Tam , Hong-Yu Chiu

Stability of graph neural networks (GNNs) characterizes how GNNs react to graph perturbations and provides guarantees for architecture performance in noisy scenarios. This paper develops a self-regularized graph neural network (SR-GNN)…

Signal Processing · Electrical Eng. & Systems 2022-11-15 Zhan Gao , Elvin Isufi

Generative adversarial networks (GANs) are innovative techniques for learning generative models of complex data distributions from samples. Despite remarkable recent improvements in generating realistic images, one of their major…

Machine Learning · Computer Science 2018-11-05 Zinan Lin , Ashish Khetan , Giulia Fanti , Sewoong Oh

Despite its short history, Generative Adversarial Network (GAN) has been extensively studied and used for various tasks, including its original purpose, i.e., synthetic sample generation. However, applying GAN to different data types with…

Image and Video Processing · Electrical Eng. & Systems 2020-05-20 Minhyeok Lee , Junhee Seok