English
Related papers

Related papers: Data-Efficient GAN Training Beyond (Just) Augmenta…

200 papers

We extend and improve the work of Model Agnostic Anchors for explanations on image classification through the use of generative adversarial networks (GANs). Using GANs, we generate samples from a more realistic perturbation distribution, by…

Machine Learning · Statistics 2019-06-04 Kurtis Evan David , Harrison Keane , Jun Min Noh

According to the Strong Lottery Ticket Hypothesis, every sufficiently large neural network with randomly initialized weights contains a sub-network which - still with its random weights - already performs as well for a given task as the…

Neural and Evolutionary Computing · Computer Science 2024-11-08 Philipp Altmann , Julian Schönberger , Maximilian Zorn , Thomas Gabor

Since their inception Generative Adversarial Networks (GANs) have been popular generative models across images, audio, video, and tabular data. In this paper we study whether given access to a trained GAN, as well as fresh samples from the…

Machine Learning · Computer Science 2023-10-19 Lukman Olagoke , Salil Vadhan , Seth Neel

Recent years have witnessed the rapid progress of generative adversarial networks (GANs). However, the success of the GAN models hinges on a large amount of training data. This work proposes a regularization approach for training robust GAN…

Machine Learning · Computer Science 2021-04-08 Hung-Yu Tseng , Lu Jiang , Ce Liu , Ming-Hsuan Yang , Weilong Yang

Lottery Ticket Hypothesis (LTH) claims the existence of a winning ticket (i.e., a properly pruned sub-network together with original weight initialization) that can achieve competitive performance to the original dense network. A recent…

Machine Learning · Computer Science 2023-05-04 Bo Hui , Da Yan , Xiaolong Ma , Wei-Shinn Ku

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

Traditional generative adversarial networks (GAN) and many of its variants are trained by minimizing the KL or JS-divergence loss that measures how close the generated data distribution is from the true data distribution. A recent advance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Generative Adversarial Networks (GANs) have gained a lot of attention from machine learning community due to their ability to learn and mimic an input data distribution. GANs consist of a discriminator and a generator working in tandem…

Computation and Language · Computer Science 2018-06-19 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Data sparsity is one of the key challenges associated with model development in Natural Language Understanding (NLU) for conversational agents. The challenge is made more complex by the demand for high quality annotated utterances commonly…

Computation and Language · Computer Science 2020-12-11 Olga Golovneva , Charith Peris

Graph learning methods help utilize implicit relationships among data items, thereby reducing training label requirements and improving task performance. However, determining the optimal graph structure for a particular learning task…

Machine Learning · Computer Science 2023-12-11 Anton Tsitsulin , Bryan Perozzi

Generative data augmentation, which scales datasets by obtaining fake labeled examples from a trained conditional generative model, boosts classification performance in various learning tasks including (semi-)supervised learning, few-shot…

Machine Learning · Computer Science 2023-05-30 Chenyu Zheng , Guoqiang Wu , Chongxuan Li

Generative Adversarial Networks (GANs) have demonstrated unprecedented success in various image generation tasks. The encouraging results, however, come at the price of a cumbersome training process, during which the generator and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Chengchao Shen , Youtan Yin , Xinchao Wang , Xubin Li , Jie Song , Mingli Song

Generative adversarial networks (GANs) have been shown to provide an effective way to model complex distributions and have obtained impressive results on various challenging tasks. However, typical GANs require fully-observed data during…

Machine Learning · Computer Science 2019-02-27 Steven Cheng-Xian Li , Bo Jiang , Benjamin Marlin

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

Machine Learning · Computer Science 2021-02-25 Toan Pham Van , Tam Minh Nguyen , Ngoc N. Tran , Hoai Viet Nguyen , Linh Bao Doan , Huy Quang Dao , Thanh Ta Minh

We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial…

Machine Learning · Computer Science 2019-04-17 Xuanqing Liu , Cho-Jui Hsieh

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

We present a learned image compression system based on GANs, operating at extremely low bitrates. Our proposed framework combines an encoder, decoder/generator and a multi-scale discriminator, which we train jointly for a generative learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Eirikur Agustsson , Michael Tschannen , Fabian Mentzer , Radu Timofte , Luc Van Gool

The fact that image datasets are often imbalanced poses an intense challenge for deep learning techniques. In this paper, we propose a method to restore the balance in imbalanced images, by coalescing two concurrent methods, generative…

Machine Learning · Computer Science 2020-04-09 Pourya Shamsolmoali , Masoumeh Zareapoor , Linlin Shen , Abdul Hamid Sadka , Jie Yang

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung