English
Related papers

Related papers: Consistency Regularization for Generative Adversar…

200 papers

We present a deep learning model for data-driven simulations of random dynamical systems without a distributional assumption. The deep learning model consists of a recurrent neural network, which aims to learn the time marching structure,…

Machine Learning · Computer Science 2022-04-12 Kyongmin Yeo , Zan Li , Wesley M. Gifford

Generative Adversarial Networks (GANs) have become a powerful approach for generative image modeling. However, GANs are notorious for their training instability, especially on large-scale, complex datasets. While the recent work of BigGAN…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Ting-Yun Chang , Chi-Jen Lu

Both generative adversarial networks (GAN) in unsupervised learning and actor-critic methods in reinforcement learning (RL) have gained a reputation for being difficult to optimize. Practitioners in both fields have amassed a large number…

Machine Learning · Computer Science 2017-01-19 David Pfau , Oriol Vinyals

Various normalization layers have been proposed to help the training of neural networks. Group Normalization (GN) is one of the effective and attractive studies that achieved significant performances in the visual recognition task. Despite…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Agus Gunawan , Xu Yin , Kang Zhang

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Statistics 2019-11-05 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Computer Science 2019-11-07 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf

Lipschitz continuity recently becomes popular in generative adversarial networks (GANs). It was observed that the Lipschitz regularized discriminator leads to improved training stability and sample quality. The mainstream implementations of…

Machine Learning · Computer Science 2019-04-03 Zhiming Zhou , Jian Shen , Yuxuan Song , Weinan Zhang , Yong Yu

The training process of generative adversarial networks (GANs) is unstable and does not converge globally. In this paper, we examine the stability of GANs from the perspective of control theory and propose a universal higher-order…

Machine Learning · Computer Science 2023-06-21 Tianjiao Luo , Ziyu Zhu , Jianfei Chen , Jun Zhu

Although existing Quantization-Aware Training (QAT) methods intensively depend on knowledge distillation to guarantee performance, QAT still suffers from severe performance drop. The experiments have shown that vanilla quantization is…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Junbiao Pang , Tianyang Cai , Baochang Zhang , Jiaqi Wu

Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We…

Machine Learning · Statistics 2017-07-24 Augustus Odena , Christopher Olah , Jonathon Shlens

While Generative Adversarial Networks (GANs) have seen huge successes in image synthesis tasks, they are notoriously difficult to adapt to different datasets, in part due to instability during training and sensitivity to hyperparameters.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Animesh Karnewar , Oliver Wang

Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images. One of the methods is to use conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Xudong Mao , Qing Li , Haoran Xie

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Anomaly detection is a fundamental problem in computer vision area with many real-world applications. Given a wide range of images belonging to the normal class, emerging from some distribution, the objective of this task is to construct…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Chengwei Chen , Pan Chen , Haichuan Song , Yiqing Tao , Yuan Xie , Shouhong Ding , Lizhuang Ma

Consistency regularization is one of the most widely-used techniques for semi-supervised learning (SSL). Generally, the aim is to train a model that is invariant to various data augmentations. In this paper, we revisit this idea and find…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Yue Fan , Anna Kukleva , Bernt Schiele

We propose a novel GAN training scheme that can handle any level of labeling in a unified manner. Our scheme introduces a form of artificial labeling that can incorporate manually defined labels, when available, and induce an alignment…

Machine Learning · Computer Science 2021-06-21 Tomoki Watanabe , Paolo Favaro

Generative Adversarial Networks (GANs) can help overcome data scarcity in computer vision tasks by generating additional training samples. In this work, we explore generative data augmentation in two low-resource domains: Bangla handwritten…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Md. Sohanuzzaman Soad , Mahady Al Hady , S M Rafiuddin Rifat , Sudip Ghose

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

Generative Adversarial Networks (GANs) are an arrange of two neural networks -- the generator and the discriminator -- that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Manel Mateos , Alejandro González , Xavier Sevillano

The task of few-shot GAN adaptation aims to adapt a pre-trained GAN model to a small dataset with very few training images. While existing methods perform well when the dataset for pre-training is structurally similar to the target dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Vadim Sushko , Ruyu Wang , Juergen Gall