English
Related papers

Related papers: ABCAS: Adaptive Bound Control of spectral norm as …

200 papers

In this paper, we propose a novel regularization method for Generative Adversarial Networks, which allows the model to learn discriminative yet compact binary representations of image patches (image descriptors). We employ the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Maciej Zieba , Piotr Semberecki , Tarek El-Gaaly , Tomasz Trzcinski

In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback…

Artificial Intelligence · Computer Science 2020-12-29 Ryoichi Takase , Nobuyuki Yoshikawa , Toshisada Mariyama , Takeshi Tsuchiya

Neural network training is commonly accelerated by using multiple synchronized workers to compute gradient updates in parallel. Asynchronous methods remove synchronization overheads and improve hardware utilization at the cost of…

Machine Learning · Computer Science 2020-07-13 Abhinav Venigalla , Atli Kosson , Vitaliy Chiley , Urs Köster

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

Anomaly detection is a classical problem where the aim is to detect anomalous data that do not belong to the normal data distribution. Current state-of-the-art methods for anomaly detection on complex high-dimensional data are based on the…

Machine Learning · Computer Science 2019-04-03 Cuong Phuc Ngo , Amadeus Aristo Winarto , Connie Kou Khor Li , Sojeong Park , Farhan Akram , Hwee Kuan Lee

In recent years, multi-scale generative adversarial networks (GANs) have been proposed to build generalized image processing models based on single sample. Constraining on the sample size, multi-scale GANs have much difficulty converging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jing Tang , Bo Tao , Zeyu Gong , Zhouping Yin

To make Robotics and Augmented Reality applications robust to illumination changes, the current trend is to train a Deep Network with training images captured under many different lighting conditions. Unfortunately, creating such a training…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Mahdi Rad , Peter M. Roth , Vincent Lepetit

Machine learning models are often misspecified in the likelihood, which leads to a lack of robustness in the predictions. In this paper, we introduce a framework for correcting likelihood misspecifications in several paradigm agnostic noisy…

Machine Learning · Computer Science 2023-04-11 Pronoma Banerjee , Manasi V Gude , Rajvi J Sampat , Sharvari M Hedaoo , Soma Dhavala , Snehanshu Saha

Generative adversarial networks (GANs), famous for the capability of learning complex underlying data distribution, are however known to be tricky in the training process, which would probably result in mode collapse or performance…

Machine Learning · Computer Science 2020-04-23 Dong Wang , Xiaoqian Qin , Fengyi Song , Li Cheng

Generative Adversarial Networks (GANs) have been widely applied in different scenarios thanks to the development of deep neural networks. The original GAN was proposed based on the non-parametric assumption of the infinite capacity of…

Machine Learning · Computer Science 2022-11-04 Ziqiang Li , Muhammad Usman , Rentuo Tao , Pengfei Xia , Chaoyue Wang , Huanhuan Chen , Bin Li

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

We pursue a line of research that seeks to regularize the spectral norm of the Jacobian of the input-output mapping for deep neural networks. While previous work rely on upper bounding techniques, we provide a scheme that targets the exact…

Machine Learning · Statistics 2022-06-29 Anton Johansson , Claes Strannegård , Niklas Engsner , Petter Mostad

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv

To improve the stability of GAN training we need to understand why they can produce realistic samples. Presently, this is attributed to properties of the divergence obtained under an optimal discriminator. This argument has a fundamental…

Machine Learning · Computer Science 2020-11-03 Florian Schäfer , Hongkai Zheng , Anima Anandkumar

We propose a second order gradient based method with ADAM and RMSprop for the training of generative adversarial networks. The proposed method is fastest to obtain similar accuracy when compared to prominent second order methods. Unlike…

Machine Learning · Computer Science 2023-04-21 Sachin Kumar Danisetty , Santhosh Reddy Mylaram , Pawan Kumar

Wasserstein-GANs have been introduced to address the deficiencies of generative adversarial networks (GANs) regarding the problems of vanishing gradients and mode collapse during the training, leading to improved convergence behaviour and…

Machine Learning · Computer Science 2019-12-17 Jan Müller , Reinhard Klein , Michael Weinmann

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

In this work, we propose CBiGAN -- a novel method for anomaly detection in images, where a consistency constraint is introduced as a regularization term in both the encoder and decoder of a BiGAN. Our model exhibits fairly good modeling…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Fabio Carrara , Giuseppe Amato , Luca Brombin , Fabrizio Falchi , Claudio Gennaro