English
Related papers

Related papers: Training Generative Adversarial Networks with Adap…

200 papers

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

Machine Learning · Statistics 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Systematic trading strategies are algorithmic procedures that allocate assets aiming to optimize a certain performance criterion. To obtain an edge in a highly competitive environment, the analyst needs to proper fine-tune its strategy, or…

Machine Learning · Computer Science 2019-04-02 Adriano Koshiyama , Nick Firoozye , Philip Treleaven

Conditional Generative Adversarial Networks (cGAN) were designed to generate images based on the provided conditions, \eg, class-level distributions. However, existing methods have used the same generating architecture for all classes. This…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Peng Zhou , Lingxi Xie , Xiaopeng Zhang , Bingbing Ni , Qi Tian

We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently…

Machine Learning · Computer Science 2022-11-02 Maksim Makarenko , Elnur Gasanov , Rustem Islamov , Abdurakhmon Sadiev , Peter Richtarik

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Recently, deep neural networks have significant progress and successful application in various fields, but they are found vulnerable to attack instances, e.g., adversarial examples. State-of-art attack methods can generate attack images by…

Machine Learning · Computer Science 2019-03-19 Ping Yu , Kaitao Song , Jianfeng Lu

Despite the success of generative adversarial networks (GANs) in generating visually appealing images, they are notoriously challenging to train. In order to stabilize the learning dynamics in minimax games, we propose a novel recursive…

Machine Learning · Computer Science 2022-11-01 Zichu Liu , Lacra Pavel

In recent years, Generative Adversarial Networks (GANs) have drawn a lot of attentions for learning the underlying distribution of data in various applications. Despite their wide applicability, training GANs is notoriously difficult. This…

Machine Learning · Computer Science 2019-04-23 Babak Barazandeh , Meisam Razaviyayn , Maziar Sanjabi

Generative adversarial networks, which can generate metasurfaces based on a training set of high performance device layouts, have the potential to significantly reduce the computational cost of the metasurface design process. However, basic…

Computational Physics · Physics 2019-12-03 Fufang Wen , Jiaqi Jiang , Jonathan A. Fan

Training Artificial Neural Networks poses a challenging and critical problem in machine learning. Despite the effectiveness of gradient-based learning methods, such as Stochastic Gradient Descent (SGD), in training neural networks, they do…

Training of Generative Adversarial Network (GAN) on a video dataset is a challenge because of the sheer size of the dataset and the complexity of each observation. In general, the computational cost of training GAN scales exponentially with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Masaki Saito , Shunta Saito , Masanori Koyama , Sosuke Kobayashi

In learning from demonstrations, many generative models of trajectories make simplifying assumptions of independence. Correctness is sacrificed in the name of tractability and speed of the learning phase. The ignored dependencies, which…

Robotics · Computer Science 2020-11-09 Emmanuel Pignat , Hakan Girgin , Sylvain Calinon

Motivated by the pursuit of a systematic computational and algorithmic understanding of Generative Adversarial Networks (GANs), we present a simple yet unified non-asymptotic local convergence theory for smooth two-player games, which…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , James Stokes

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Generative Adversarial Networks (GANs) have shown promise in augmenting datasets and boosting convolutional neural networks' (CNN) performance on image classification tasks. But they introduce more hyperparameters to tune as well as the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Amil Dravid , Florian Schiffers , Yunan Wu , Oliver Cossairt , Aggelos K. Katsaggelos

Adversarial training has gained great popularity as one of the most effective defenses for deep neural network and more generally for gradient-based machine learning models against adversarial perturbations on data points. This paper…

Machine Learning · Computer Science 2023-05-25 Haotian Gu , Xin Guo , Xinyu Li

Generative adversarial networks (GANs) has gained tremendous popularity lately due to an ability to reinforce quality of its predictive model with generated objects and the quality of the generative model with and supervised feedback. GANs…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Evgeny Zamyatin , Andrey Filchenkov

In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs). Using the formalism of smooth two-player games we analyze the associated gradient vector field of GAN training objectives. Our…

Machine Learning · Computer Science 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

When robots work in a cluttered environment, the constraints for motions change frequently and the required action can change even for the same task. However, planning complex motions from direct calculation has the risk of resulting in…

Robotics · Computer Science 2019-10-09 Kyo Kutsuzawa , Hitoshi Kusano , Ayaka Kume , Shoichiro Yamaguchi

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio