中文
相关论文

相关论文: Sample weighting as an explanation for mode collap…

200 篇论文

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

机器学习 · 统计学 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Deep learning has revolutionized various fields, yet its efficacy is hindered by overfitting and the requirement of extensive annotated data, particularly in few-shot learning scenarios where limited samples are available. This paper…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Jiacheng Hu , Zhen Qi , Jianjun Wei , Jiajing Chen , Runyuan Bao , Xinyu Qiu

We propose in this paper a novel approach to tackle the problem of mode collapse encountered in generative adversarial network (GAN). Our idea is intuitive but proven to be very effective, especially in addressing some key limitations of…

机器学习 · 计算机科学 2017-09-13 Tu Dinh Nguyen , Trung Le , Hung Vu , Dinh Phung

In this paper, we study deep generative models for effective unsupervised learning. We propose VGAN, which works by minimizing a variational lower bound of the negative log likelihood (NLL) of an energy based model (EBM), where the model…

机器学习 · 计算机科学 2016-11-08 Shuangfei Zhai , Yu Cheng , Rogerio Feris , Zhongfei Zhang

Generative adversarial networks (GANs) are very popular to generate realistic images, but they often suffer from the training instability issues and the phenomenon of mode loss. In order to attain greater diversity in GAN synthesized data,…

机器学习 · 计算机科学 2021-07-13 Blessen George , Vinod K. Kurmi , Vinay P. Namboodiri

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

机器学习 · 计算机科学 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Conditional generation of time-dependent data is a task that has much interest, whether for data augmentation, scenario simulation, completing missing data, or other purposes. Recent works proposed a Transformer-based Time series generative…

Generative adversary networks (GANs) suffer from training pathologies such as instability and mode collapse. These pathologies mainly arise from a lack of diversity in their adversarial interactions. Evolutionary generative adversarial…

神经与进化计算 · 计算机科学 2019-05-31 Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

机器学习 · 计算机科学 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv

Generative Adversarial Network(GAN) provides a good generative framework to produce realistic samples, but suffers from two recognized issues as mode collapse and unstable training. In this work, we propose to employ explicit manifold…

机器学习 · 计算机科学 2020-06-20 Guanhua Zheng , Jitao Sang , Changsheng Xu

Generative Adversarial Networks (GAN) offer a promising approach for Neural Machine Translation (NMT). However, feeding multiple morphologically languages into a single model during training reduces the NMT's performance. In GAN, similar to…

计算与语言 · 计算机科学 2023-04-03 Amit Kumar , Ajay Pratap , Anil Kumar Singh

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

机器学习 · 计算机科学 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Training generative models that can generate high-quality text with sufficient diversity is an important open problem for Natural Language Generation (NLG) community. Recently, generative adversarial models have been applied extensively on…

计算与语言 · 计算机科学 2020-03-26 Haiyan Yin , Dingcheng Li , Xu Li , Ping Li

Generative Adversarial Networks (GANs) have shown remarkable performance in image generation. However, GAN training suffers from the problem of instability. One of the main approaches to address this problem is to modify the loss function,…

机器学习 · 计算机科学 2024-03-19 Iu Yahiro , Takashi Ishida , Naoto Yokoya

Conventional deep network training generally optimizes all samples under a largely uniform learning paradigm, without explicitly modeling the heterogeneous competition among them. Such an oversimplified treatment can lead to several…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Ying Zheng , Yiyi Zhang , Yi Wang , Lap-Pui Chau

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

机器学习 · 计算机科学 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

Generative Adversarial Networks (GANs) can achieve state-of-the-art sample quality in generative modelling tasks but suffer from the mode collapse problem. Variational Autoencoders (VAE) on the other hand explicitly maximize a…

机器学习 · 计算机科学 2019-09-30 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

Though generative adversarial networks (GANs) areprominent models to generate realistic and crisp images,they often encounter the mode collapse problems and arehard to train, which comes from approximating the intrinsicdiscontinuous…

计算机视觉与模式识别 · 计算机科学 2020-01-28 Dongsheng An , Yang Guo , Min Zhang , Xin Qi , Na Lei , Shing-Tung Yau , Xianfeng Gu

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

机器学习 · 统计学 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

In recent studies, Generative Adversarial Network (GAN) is one of the popular schemes to augment the image dataset. However, in our study we find the generator G in the GAN fails to generate numerical data in lower-dimensional spaces, and…

机器学习 · 计算机科学 2020-10-27 Wei Wang , Yimeng Chai , Tao Cui , Chuang Wang , Baohua Zhang , Yue Li , Yi An