中文
相关论文

相关论文: On gradient regularizers for MMD GANs

200 篇论文

While Generative Adversarial Networks (GANs) have seen huge successes in image synthesis tasks, they are notoriously difficult to adapt to different datasets, in part due to instability during training and sensitivity to hyperparameters.…

计算机视觉与模式识别 · 计算机科学 2020-06-16 Animesh Karnewar , Oliver Wang

Generative Adversarial Networks (GANs) have shown notable accomplishments in remote sensing domain. However, this paper reveals that their performance on remote sensing images falls short when compared to their impressive results with…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Xingzhe Su , Changwen Zheng , Wenwen Qiang , Fengge Wu , Junsuo Zhao , Fuchun Sun , Hui Xiong

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of these models to…

机器学习 · 计算机科学 2020-02-06 B. S. Vivek , R. Venkatesh Babu

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

机器学习 · 计算机科学 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

Effective regularisation of neural networks is essential to combat overfitting due to the large number of parameters involved. We present an empirical analogue to the Lipschitz constant of a feed-forward neural network, which we refer to as…

机器学习 · 统计学 2018-07-03 Henry Gouk , Bernhard Pfahringer , Eibe Frank , Michael Cree

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learning algorithm. Nonetheless, various forms of regularization,…

机器学习 · 计算机科学 2022-02-23 Navid Azizan , Sahin Lale , Babak Hassibi

Diabetic retinopathy (DR) is a complication of diabetes that severely affects eyes. It can be graded into five levels of severity according to international protocol. However, optimizing a grading model to have strong generalizability…

图像与视频处理 · 电气工程与系统科学 2020-12-22 Yi Zhou , Boyang Wang , Xiaodong He , Shanshan Cui , Ling Shao

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

计算机视觉与模式识别 · 计算机科学 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

GANS are powerful generative models that are able to model the manifold of natural images. We leverage this property to perform manifold regularization by approximating the Laplacian norm using a Monte Carlo approximation that is easily…

机器学习 · 计算机科学 2018-05-24 Bruno Lecouat , Chuan-Sheng Foo , Houssam Zenati , Vijay R. Chandrasekhar

It is well-known that GANs are difficult to train, and several different techniques have been proposed in order to stabilize their training. In this paper, we propose a novel training method called manifold-matching, and a new GAN model…

We propose studying GAN training dynamics as regret minimization, which is in contrast to the popular view that there is consistent minimization of a divergence between real and generated distributions. We analyze the convergence of GAN…

人工智能 · 计算机科学 2017-12-12 Naveen Kodali , Jacob Abernethy , James Hays , Zsolt Kira

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details…

神经与进化计算 · 计算机科学 2018-02-28 Tero Karras , Timo Aila , Samuli Laine , Jaakko Lehtinen

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

We propose a novel supervised learning method to optimize the kernel in the maximum mean discrepancy generative adversarial networks (MMD GANs), and the kernel support vector machines (SVMs). Specifically, we characterize a distributionally…

机器学习 · 计算机科学 2020-02-25 Masoud Badiei Khuzani , Liyue Shen , Shahin Shahrampour , Lei Xing

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

机器学习 · 计算机科学 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their…

机器学习 · 计算机科学 2019-10-21 Dae Hoon Park , Chiu Man Ho , Yi Chang , Huaqing Zhang

Generative adversarial networks (GANs) have emerged as a powerful tool for generating high-fidelity data. However, the main bottleneck of existing approaches is the lack of supervision on the generator training, which often results in…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Baoren Xiao , Hao Ni , Weixin Yang

The training process of generative adversarial networks (GANs) is unstable and does not converge globally. In this paper, we examine the stability of GANs from the perspective of control theory and propose a universal higher-order…

机器学习 · 计算机科学 2023-06-21 Tianjiao Luo , Ziyu Zhu , Jianfei Chen , Jun Zhu

In order to alleviate the notorious mode collapse phenomenon in generative adversarial networks (GANs), we propose a novel training method of GANs in which certain fake samples are considered as real ones during the training process. This…

机器学习 · 计算机科学 2020-03-17 Song Tao , Jia Wang

A novel approach for unsupervised domain adaptation for neural networks is proposed. It relies on metric-based regularization of the learning process. The metric-based regularization aims at domain-invariant latent feature representations…