English
Related papers

Related papers: Sample weighting as an explanation for mode collap…

200 papers

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Deep learning has revolutionized various fields, yet its efficacy is hindered by overfitting and the requirement of extensive annotated data, particularly in few-shot learning scenarios where limited samples are available. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiacheng Hu , Zhen Qi , Jianjun Wei , Jiajing Chen , Runyuan Bao , Xinyu Qiu

We propose in this paper a novel approach to tackle the problem of mode collapse encountered in generative adversarial network (GAN). Our idea is intuitive but proven to be very effective, especially in addressing some key limitations of…

Machine Learning · Computer Science 2017-09-13 Tu Dinh Nguyen , Trung Le , Hung Vu , Dinh Phung

In this paper, we study deep generative models for effective unsupervised learning. We propose VGAN, which works by minimizing a variational lower bound of the negative log likelihood (NLL) of an energy based model (EBM), where the model…

Machine Learning · Computer Science 2016-11-08 Shuangfei Zhai , Yu Cheng , Rogerio Feris , Zhongfei Zhang

Generative adversarial networks (GANs) are very popular to generate realistic images, but they often suffer from the training instability issues and the phenomenon of mode loss. In order to attain greater diversity in GAN synthesized data,…

Machine Learning · Computer Science 2021-07-13 Blessen George , Vinod K. Kurmi , Vinay P. Namboodiri

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Conditional generation of time-dependent data is a task that has much interest, whether for data augmentation, scenario simulation, completing missing data, or other purposes. Recent works proposed a Transformer-based Time series generative…

Machine Learning · Computer Science 2022-10-06 Abdellah Madane , Mohamed-djallel Dilmi , Florent Forest , Hanane Azzag , Mustapha Lebbah , Jerome Lacaille

Generative adversary networks (GANs) suffer from training pathologies such as instability and mode collapse. These pathologies mainly arise from a lack of diversity in their adversarial interactions. Evolutionary generative adversarial…

Neural and Evolutionary Computing · Computer Science 2019-05-31 Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv

Generative Adversarial Network(GAN) provides a good generative framework to produce realistic samples, but suffers from two recognized issues as mode collapse and unstable training. In this work, we propose to employ explicit manifold…

Machine Learning · Computer Science 2020-06-20 Guanhua Zheng , Jitao Sang , Changsheng Xu

Generative Adversarial Networks (GAN) offer a promising approach for Neural Machine Translation (NMT). However, feeding multiple morphologically languages into a single model during training reduces the NMT's performance. In GAN, similar to…

Computation and Language · Computer Science 2023-04-03 Amit Kumar , Ajay Pratap , Anil Kumar Singh

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

Machine Learning · Computer Science 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Training generative models that can generate high-quality text with sufficient diversity is an important open problem for Natural Language Generation (NLG) community. Recently, generative adversarial models have been applied extensively on…

Computation and Language · Computer Science 2020-03-26 Haiyan Yin , Dingcheng Li , Xu Li , Ping Li

Generative Adversarial Networks (GANs) have shown remarkable performance in image generation. However, GAN training suffers from the problem of instability. One of the main approaches to address this problem is to modify the loss function,…

Machine Learning · Computer Science 2024-03-19 Iu Yahiro , Takashi Ishida , Naoto Yokoya

Conventional deep network training generally optimizes all samples under a largely uniform learning paradigm, without explicitly modeling the heterogeneous competition among them. Such an oversimplified treatment can lead to several…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ying Zheng , Yiyi Zhang , Yi Wang , Lap-Pui Chau

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

Machine Learning · Computer Science 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

Generative Adversarial Networks (GANs) can achieve state-of-the-art sample quality in generative modelling tasks but suffer from the mode collapse problem. Variational Autoencoders (VAE) on the other hand explicitly maximize a…

Machine Learning · Computer Science 2019-09-30 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

Though generative adversarial networks (GANs) areprominent models to generate realistic and crisp images,they often encounter the mode collapse problems and arehard to train, which comes from approximating the intrinsicdiscontinuous…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Dongsheng An , Yang Guo , Min Zhang , Xin Qi , Na Lei , Shing-Tung Yau , Xianfeng Gu

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

In recent studies, Generative Adversarial Network (GAN) is one of the popular schemes to augment the image dataset. However, in our study we find the generator G in the GAN fails to generate numerical data in lower-dimensional spaces, and…

Machine Learning · Computer Science 2020-10-27 Wei Wang , Yimeng Chai , Tao Cui , Chuang Wang , Baohua Zhang , Yue Li , Yi An
‹ Prev 1 3 4 5 6 7 10 Next ›