中文
相关论文

相关论文: GANs Can Play Lottery Tickets Too

200 篇论文

The lottery ticket hypothesis questions the role of overparameterization in supervised deep learning. But how is the performance of winning lottery tickets affected by the distributional shift inherent to reinforcement learning problems? In…

机器学习 · 计算机科学 2022-05-11 Marc Aurel Vischer , Robert Tjarko Lange , Henning Sprekeler

In recent years, neural network approaches have been widely adopted for machine learning tasks, with applications in computer vision. More recently, unsupervised generative models based on neural networks have been successfully applied to…

机器学习 · 计算机科学 2018-02-06 Maya Kabkab , Pouya Samangouei , Rama Chellappa

Generative Adversarial Networks (GANs) have made great progress in synthesizing realistic images in recent years. However, they are often trained on image datasets with either too few samples or too many classes belonging to different data…

机器学习 · 计算机科学 2020-10-16 Shichang Tang

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

机器学习 · 统计学 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam

In traditional generative modeling, good data representation is very often a base for a good machine learning model. It can be linked to good representations encoding more explanatory factors that are hidden in the original data. With the…

机器学习 · 计算机科学 2019-04-01 Maciej Zamorski , Adrian Zdobylak , Maciej Zięba , Jerzy Świątek

Generative Adversarial Networks (GANs) have been used in several machine learning tasks such as domain transfer, super resolution, and synthetic data generation. State-of-the-art GANs often use tens of millions of parameters, making them…

机器学习 · 计算机科学 2019-02-04 Angeline Aguinaldo , Ping-Yeh Chiang , Alex Gain , Ameya Patil , Kolten Pearson , Soheil Feizi

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

机器学习 · 计算机科学 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

The Lottery Ticket Hypothesis (LTH) states that a dense neural network model contains a highly sparse subnetwork (i.e., winning tickets) that can achieve even better performance than the original model when trained in isolation. While LTH…

机器学习 · 计算机科学 2024-03-14 Bohan Liu , Zijie Zhang , Peixiong He , Zhensen Wang , Yang Xiao , Ruimeng Ye , Yang Zhou , Wei-Shinn Ku , Bo Hui

In recent years, Generative Adversarial Networks (GANs) have shown substantial progress in modeling complex distributions of data. These networks have received tremendous attention since they can generate implicit probabilistic models that…

信号处理 · 电气工程与系统科学 2018-10-25 Mehdi Ahmadi , Timothy Nest , Mostafa Abdelnaim , Thanh-Dung Le

Generative adversarial networks (GAN) are a powerful subclass of generative models. Despite a very rich research activity leading to numerous interesting GAN algorithms, it is still very hard to assess which algorithm(s) perform better than…

机器学习 · 统计学 2018-10-30 Mario Lucic , Karol Kurach , Marcin Michalski , Sylvain Gelly , Olivier Bousquet

Generative adversarial networks (GANs) are pairs of artificial neural networks that are trained one against each other. The outputs from a generator are mixed with the real-world inputs to the discriminator and both networks are trained…

神经与进化计算 · 计算机科学 2020-06-11 Andrei Kucharavy , El Mahdi El Mhamdi , Rachid Guerraoui

Lottery Ticket Hypothesis (LTH) claims the existence of a winning ticket (i.e., a properly pruned sub-network together with original weight initialization) that can achieve competitive performance to the original dense network. A recent…

机器学习 · 计算机科学 2023-05-04 Bo Hui , Da Yan , Xiaolong Ma , Wei-Shinn Ku

We present a compression algorithm for parton densities using synthetic replicas generated from the training of a Generative Adversarial Network (GAN). The generated replicas are used to further enhance the statistics of a given Monte Carlo…

高能物理 - 唯象学 · 物理学 2021-07-07 Stefano Carrazza , Juan M. Cruz-Martinez , Tanjona R. Rabemananjara

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

人工智能 · 计算机科学 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

The Lottery Ticket Hypothesis suggests large, over-parameterized neural networks consist of small, sparse subnetworks that can be trained in isolation to reach a similar (or better) test accuracy. However, the initialization and…

计算与语言 · 计算机科学 2019-10-29 Shrey Desai , Hongyuan Zhan , Ahmed Aly

Pre-training serves as a broadly adopted starting point for transfer learning on various downstream tasks. Recent investigations of lottery tickets hypothesis (LTH) demonstrate such enormous pre-trained models can be replaced by extremely…

机器学习 · 计算机科学 2022-06-13 Tianlong Chen , Zhenyu Zhang , Sijia Liu , Yang Zhang , Shiyu Chang , Zhangyang Wang

Generative adversarial networks (GANs) implicitly learn the probability distribution of a dataset and can draw samples from the distribution. This paper presents, Tabular GAN (TGAN), a generative adversarial network which can generate…

机器学习 · 计算机科学 2018-11-29 Lei Xu , Kalyan Veeramachaneni

Since their inception Generative Adversarial Networks (GANs) have been popular generative models across images, audio, video, and tabular data. In this paper we study whether given access to a trained GAN, as well as fresh samples from the…

机器学习 · 计算机科学 2023-10-19 Lukman Olagoke , Salil Vadhan , Seth Neel

Generative Adversarial networks (GANs) have obtained remarkable success in many unsupervised learning tasks and unarguably, clustering is an important unsupervised learning problem. While one can potentially exploit the latent-space…

机器学习 · 计算机科学 2019-01-29 Sudipto Mukherjee , Himanshu Asnani , Eugene Lin , Sreeram Kannan

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously…

机器学习 · 计算机科学 2019-05-15 Karol Kurach , Mario Lucic , Xiaohua Zhai , Marcin Michalski , Sylvain Gelly