中文
相关论文

相关论文: On the Effects of Batch and Weight Normalization i…

200 篇论文

Batch Normalization (BN) is an important preprocessing step to many deep learning applications. Since it is a data-dependent process, for some homogeneous datasets it is a redundant or even a performance-degrading process. In this paper, we…

机器学习 · 计算机科学 2022-12-01 Wael Alsobhi , Tarik Alafif , Alaa Abdel-Hakim , Weiwei Zong

Batch Normalization (BatchNorm) is effective for improving the performance and accelerating the training of deep neural networks. However, it has also shown to be a cause of adversarial vulnerability, i.e., networks without it are more…

机器学习 · 计算机科学 2020-06-22 Muhammad Awais , Fahad Shamshad , Sung-Ho Bae

Despite the growing interest in generative adversarial networks (GANs), training GANs remains a challenging problem, both from a theoretical and a practical standpoint. To address this challenge, in this paper, we propose a novel way to…

机器学习 · 计算机科学 2018-11-27 Qunwei Li , Bhavya Kailkhura , Rushil Anirudh , Yi Zhou , Yingbin Liang , Pramod Varshney

Recent years have witnessed the rapid progress of generative adversarial networks (GANs). However, the success of the GAN models hinges on a large amount of training data. This work proposes a regularization approach for training robust GAN…

机器学习 · 计算机科学 2021-04-08 Hung-Yu Tseng , Lu Jiang , Ce Liu , Ming-Hsuan Yang , Weilong Yang

Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Sangeek Hyun , MinKyu Lee , Jae-Pil Heo

Generative Adversarial Networks (GAN) have attracted much research attention recently, leading to impressive results for natural image generation. However, to date little success was observed in using GAN generated images for improving…

计算机视觉与模式识别 · 计算机科学 2017-11-15 Xinlong Wang , Zhipeng Man , Mingyu You , Chunhua Shen

Over the past few years, Batch-Normalization has been commonly used in deep networks, allowing faster training and high performance for a wide variety of applications. However, the reasons behind its merits remained unanswered, with several…

机器学习 · 统计学 2019-02-08 Elad Hoffer , Ron Banner , Itay Golan , Daniel Soudry

We use Generative Adversarial Networks (GANs) to design a class conditional label noise (CCN) robust scheme for binary classification. It first generates a set of correctly labelled data points from noisy labelled data and 0.1% or 1% clean…

机器学习 · 计算机科学 2020-10-20 Sandhya Tripathi , N Hemachandra

Due to the outstanding capability for data generation, Generative Adversarial Networks (GANs) have attracted considerable attention in unsupervised learning. However, training GANs is difficult, since the training distribution is dynamic…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Haozhe Liu , Wentian Zhang , Bing Li , Haoqian Wu , Nanjun He , Yawen Huang , Yuexiang Li , Bernard Ghanem , Yefeng Zheng

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Generative adversarial networks (GANs) have gained considerable attention owing to their ability to reproduce images. However, they can recreate training images faithfully despite image degradation in the form of blur, noise, and…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Takuhiro Kaneko , Tatsuya Harada

In the years since Goodfellow et al. introduced Generative Adversarial Networks (GANs), there has been an explosion in the breadth and quality of generative model applications. Despite this work, GANs still have a long way to go before they…

机器学习 · 计算机科学 2020-04-14 Conor Lazarou

In recent years, Generative Adversarial Networks (GANs) have received significant attention from the research community. With a straightforward implementation and outstanding results, GANs have been used for numerous applications. Despite…

机器学习 · 计算机科学 2019-08-01 P Manisha , Sujit Gujar

Generative Adversarial Networks (GANs) can help overcome data scarcity in computer vision tasks by generating additional training samples. In this work, we explore generative data augmentation in two low-resource domains: Bangla handwritten…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Md. Sohanuzzaman Soad , Mahady Al Hady , S M Rafiuddin Rifat , Sudip Ghose

Generative Adversarial Networks are a new family of generative models, frequently used for generating photorealistic images. The theory promises for the GAN to eventually reach an equilibrium where generator produces pictures…

机器学习 · 计算机科学 2018-11-16 Ilya Kamenshchikov , Matthias Krauledat

Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of…

Generative adversarial networks (GANs) are effective in generating realistic images but the training is often unstable. There are existing efforts that model the training dynamics of GANs in the parameter space but the analysis cannot…

机器学习 · 计算机科学 2020-07-09 Kun Xu , Chongxuan Li , Jun Zhu , Bo Zhang

One of the issues faced in training Generative Adversarial Nets (GANs) and their variants is the problem of mode collapse, wherein the training stability in terms of the generative loss increases as more training data is used. In this…

机器学习 · 计算机科学 2020-11-23 Himanshu Pant , Jayadeva , Sumit Soman

Substantial experiments have validated the success of Batch Normalization (BN) Layer in benefiting convergence and generalization. However, BN requires extra memory and float-point calculation. Moreover, BN would be inaccurate on…

机器学习 · 计算机科学 2024-10-30 Wen Fei , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

The true distribution parameterizations of commonly used image datasets are inaccessible. Rather than designing metrics for feature spaces with unknown characteristics, we propose to measure GAN performance by evaluating on explicitly…

机器学习 · 计算机科学 2018-12-31 Shayne O'Brien , Matt Groh , Abhimanyu Dubey