中文
相关论文

相关论文: GANs Can Play Lottery Tickets Too

200 篇论文

A recent technical breakthrough in the domain of machine learning is the discovery and the multiple applications of Generative Adversarial Networks (GANs). Those generative models are computationally demanding, as a GAN is composed of two…

机器学习 · 计算机科学 2021-04-14 Corentin Hardy , Erwan Le Merrer , Bruno Sericola

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Simon Jenni , Paolo Favaro

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

计算机视觉与模式识别 · 计算机科学 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

Generative Adversarial Networks (GANs) are a class of neural networks that have been widely used in the field of image-to-image translation. In this paper, we propose a streamlined image-to-image translation network with a simpler…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Guangzong Chen , Mingui Sun , Zhi-Hong Mao , Kangni Liu , Wenyan Jia

In this paper, an image recognition algorithm based on the combination of deep learning and generative adversarial network (GAN) is studied, and compared with traditional image recognition methods. The purpose of this study is to evaluate…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Yihao Zhong , Yijing Wei , Yingbin Liang , Xiqing Liu , Rongwei Ji , Yiru Cang

Generative Adversarial Networks (GANs) are gaining increasing attention as a means for synthesising data. So far much of this work has been applied to use cases outside of the data confidentiality domain with a common application being the…

机器学习 · 计算机科学 2021-12-06 Claire Little , Mark Elliot , Richard Allmendinger , Sahel Shariati Samani

The true distribution parameterizations of commonly used image datasets are inaccessible. Rather than designing metrics for feature spaces with unknown characteristics, we propose to measure GAN performance by evaluating on explicitly…

机器学习 · 计算机科学 2018-12-31 Shayne O'Brien , Matt Groh , Abhimanyu Dubey

Lottery Ticket Hypothesis (LTH) suggests that a dense neural network contains a sparse sub-network that can match the performance of the original dense network when trained in isolation from scratch. Most works retrain the sparse…

机器学习 · 计算机科学 2021-10-12 Ajay Kumar Jaiswal , Haoyu Ma , Tianlong Chen , Ying Ding , Zhangyang Wang

Recent works have impressively demonstrated that there exists a subnetwork in randomly initialized convolutional neural networks (CNNs) that can match the performance of the fully trained dense networks at initialization, without any…

The lottery ticket hypothesis (LTH) is well-studied for convolutional neural networks but has been validated only empirically for graph neural networks (GNNs), for which theoretical findings are largely lacking. In this paper, we identify…

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

机器学习 · 统计学 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

机器学习 · 计算机科学 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

Generative adversarial network (GAN) is among the most popular deep learning models for learning complex data distributions. However, training a GAN is known to be a challenging task. This is often attributed to the lack of correlation…

机器学习 · 计算机科学 2020-12-15 Sahil Sidheekh , Aroof Aimen , Vineet Madan , Narayanan C. Krishnan

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined…

机器学习 · 计算机科学 2022-06-10 Jian Huang , Yuling Jiao , Zhen Li , Shiao Liu , Yang Wang , Yunfei Yang

In recent years, deep neural network approaches have been widely adopted for machine learning tasks, including classification. However, they were shown to be vulnerable to adversarial perturbations: carefully crafted small perturbations can…

计算机视觉与模式识别 · 计算机科学 2018-05-21 Pouya Samangouei , Maya Kabkab , Rama Chellappa

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

人工智能 · 计算机科学 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

机器学习 · 计算机科学 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

计算机视觉与模式识别 · 计算机科学 2019-05-24 Huaxia Wang , Chun-Nam Yu

Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the…

神经与进化计算 · 计算机科学 2021-10-29 Santiago Gonzalez , Mohak Kant , Risto Miikkulainen

Generative adversarial networks (GANs) are an exciting alternative to algorithms for solving density estimation problems---using data to assess how likely samples are to be drawn from the same distribution. Instead of explicitly computing…

机器学习 · 计算机科学 2017-09-20 Christopher Grimm , Yuhang Song , Michael L. Littman