English
Related papers

Related papers: A Neural Tangent Kernel Perspective of GANs

200 papers

Generative adversarial networks (GANs) provide a way to learn deep representations without extensively annotated training data. They achieve this through deriving backpropagation signals through a competitive process involving a pair of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Antonia Creswell , Tom White , Vincent Dumoulin , Kai Arulkumaran , Biswa Sengupta , Anil A Bharath

This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer,…

Machine Learning · Computer Science 2020-07-21 Chenyou Fan , Ping Liu

Generative adversarial networks have achieved remarkable performance on various tasks but suffer from training instability. Despite many training strategies proposed to improve training stability, this issue remains as a challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Faqiang Liu , Mingkun Xu , Guoqi Li , Jing Pei , Luping Shi , Rong Zhao

Generative adversarial networks (GANs) have demonstrated to be successful at generating realistic real-world images. In this paper we compare various GAN techniques, both supervised and unsupervised. The effects on training stability of…

Machine Learning · Computer Science 2018-03-28 Mathijs Pieters , Marco Wiering

We deconstruct the performance of GANs into three components: 1. Formulation: we propose a perturbation view of the population target of GANs. Building on this interpretation, we show that GANs can be viewed as a generalization of the…

Machine Learning · Computer Science 2019-05-21 Banghua Zhu , Jiantao Jiao , David Tse

Identifying anomalies refers to detecting samples that do not resemble the training data distribution. Many generative models have been used to find anomalies, and among them, generative adversarial network (GAN)-based approaches are…

Machine Learning · Computer Science 2022-01-03 Laya Rafiee Sevyeri , Thomas Fevens

Quantum machine learning is expected to be one of the first practical applications of near-term quantum devices. Pioneer theoretical works suggest that quantum generative adversarial networks (GANs) may exhibit a potential exponential…

Anomalous crack region detection is a typical binary semantic segmentation task, which aims to detect pixels representing cracks on pavement surface images automatically by algorithms. Although existing deep learning-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Lei Xu , Moncef Gabbouj

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

Generative Adversarial Networks (GANs) are formulated as minimax game problems, whereby generators attempt to approach real data distributions by virtue of adversarial learning against discriminators. The intrinsic problem complexity poses…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuesong Tian , Li Shen , Li Shen , Guinan Su , Zhifeng Li , Wei Liu

Two key challenges facing modern deep learning are mitigating deep networks' vulnerability to adversarial attacks and understanding deep learning's generalization capabilities. Towards the first issue, many defense strategies have been…

Machine Learning · Computer Science 2022-10-24 Noel Loo , Ramin Hasani , Alexander Amini , Daniela Rus

Generative Adversarial Networks (GANs) have recently achieved impressive results for many real-world applications, and many GAN variants have emerged with improvements in sample quality and training stability. However, they have not been…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Bolei Zhou , Joshua B. Tenenbaum , William T. Freeman , Antonio Torralba

Generative Adversarial Networks (GANs) have known a tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open…

Machine Learning · Computer Science 2022-01-31 Sylvain Lamprier , Thomas Scialom , Antoine Chaffin , Vincent Claveau , Ewa Kijak , Jacopo Staiano , Benjamin Piwowarski

Due to its causal semantics, Bayesian networks (BN) have been widely employed to discover the underlying data relationship in exploratory studies, such as brain research. Despite its success in modeling the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 Luping Zhou , Lei Wang , Lingqiao Liu , Philip Ogunbona , Dinggang Shen

A basic, and still largely unanswered, question in the context of Generative Adversarial Networks (GANs) is whether they are truly able to capture all the fundamental characteristics of the distributions they are trained on. In particular,…

Machine Learning · Computer Science 2018-06-07 Shibani Santurkar , Ludwig Schmidt , Aleksander Mądry

Generative adversarial networks (GANs) are a powerful framework for generative tasks. However, they are difficult to train and tend to miss modes of the true data generation process. Although GANs can learn a rich representation of the…

Machine Learning · Computer Science 2017-11-27 Robin Winter , Djork-Arné Clevert

We show that training of generative adversarial network (GAN) may not have good generalization properties; e.g., training may appear successful but the trained distribution may be far from target distribution in standard metrics. However,…

Machine Learning · Computer Science 2017-08-03 Sanjeev Arora , Rong Ge , Yingyu Liang , Tengyu Ma , Yi Zhang

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

In this article a surprising result is demonstrated using the neural tangent kernel. This kernel is defined as the inner product of the vector of the gradient of an underlying model evaluated at training points. This kernel is used to…

Artificial Intelligence · Computer Science 2021-04-14 Matt Calder