English
Related papers

Related papers: ABCAS: Adaptive Bound Control of spectral norm as …

200 papers

In this paper, we aim to understand the generalization properties of generative adversarial networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a differentially private learning algorithm used for…

Machine Learning · Computer Science 2019-09-26 Bingzhe Wu , Shiwan Zhao , ChaoChao Chen , Haoyang Xu , Li Wang , Xiaolu Zhang , Guangyu Sun , Jun Zhou

Generative adversarial networks (GANs) are successfully used for image synthesis but are known to face instability during training. In contrast, probabilistic diffusion models (DMs) are stable and generate high-quality images, at the cost…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Edgardo Solano-Carrillo , Angel Bueno Rodriguez , Borja Carrillo-Perez , Yannik Steiniger , Jannis Stoppe

We introduce effective training algorithms for Generative Adversarial Networks (GAN) to alleviate mode collapse and gradient vanishing. In our system, we constrain the generator by an Autoencoder (AE). We propose a formulation to consider…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

In order to alleviate the notorious mode collapse phenomenon in generative adversarial networks (GANs), we propose a novel training method of GANs in which certain fake samples are considered as real ones during the training process. This…

Machine Learning · Computer Science 2020-03-17 Song Tao , Jia Wang

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

The control of nonlinear systems with unknown dynamics has been a significant field of research for many years. This paper presents a novel data-driven optimal adaptive control structure with less control effort and faster adaptation than…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Mohammad Mahmoudi , Nasser Sadati

Deep Neural network learning for image processing faces major challenges related to changes in distribution across layers, which disrupt model convergence and performance. Activation normalization methods, such as Batch Normalization (BN),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Bilal Faye , Hanane Azzag , Mustapha Lebbah , Djamel Bouchaffra

Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class-wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem…

Machine Learning · Computer Science 2024-09-20 Kyeongbo Kong , Kyunghun Kim , Suk-Ju Kang

Generative Adversarial Networks (GANs) are considered the state-of-the-art in the field of image generation. They learn the joint distribution of the training data and attempt to generate new data samples in high dimensional space following…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Sherif Abdulatif , Karim Armanious , Fady Aziz , Urs Schneider , Bin Yang

Single domain generalization aims to learn a model that performs well on many unseen domains with only one domain data for training. Existing works focus on studying the adversarial domain augmentation (ADA) to improve the model's…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Xinjie Fan , Qifei Wang , Junjie Ke , Feng Yang , Boqing Gong , Mingyuan Zhou

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

In recent times, many of the breakthroughs in various vision-related tasks have revolved around improving learning of deep models; these methods have ranged from network architectural improvements such as Residual Networks, to various forms…

Machine Learning · Statistics 2018-05-15 Yan Zuo , Gil Avraham , Tom Drummond

We introduce a novel framework for adversarial training where the target distribution is annealed between the uniform distribution and the data distribution. We posited a conjecture that learning under continuous annealing in the…

Machine Learning · Statistics 2017-05-23 Arash Mehrjou , Bernhard Schölkopf , Saeed Saremi

Image normalization is a critical step in medical imaging. This step is often done on a per-dataset basis, preventing current segmentation algorithms from the full potential of exploiting jointly normalized information across multiple…

Machine Learning · Computer Science 2020-02-04 Pierre-Luc Delisle , Benoit Anctil-Robitaille , Christian Desrosiers , Herve Lombaert

Recent works have shown that the input domain of any machine learning classifier is bound to contain adversarial examples. Thus we can no longer hope to immune classifiers against adversarial examples and instead can only aim to achieve the…

Machine Learning · Computer Science 2020-09-25 Gil Fidel , Ron Bitton , Ziv Katzir , Asaf Shabtai

In this paper we propose a novel approach for stabilizing the training process of Generative Adversarial Networks as well as alleviating the mode collapse problem. The main idea is to introduce a regularization term that we call…

Machine Learning · Statistics 2020-08-11 Jiadong Liang , Liangyu Zhang , Cheng Zhang , Zhihua Zhang

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

The rapid progression of Generative Adversarial Networks (GANs) has raised a concern of their misuse for malicious purposes, especially in creating fake face images. Although many proposed methods succeed in detecting GAN-based synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Binh M. Le , Simon S. Woo

End-to-end, autoregressive model-based TTS has shown significant performance improvements over the conventional one. However, the autoregressive module training is affected by the exposure bias, or the mismatch between the different…

Computation and Language · Computer Science 2019-04-10 Haohan Guo , Frank K. Soong , Lei He , Lei Xie

We propose a general framework for increasing local stability of Artificial Neural Nets (ANNs) using Robust Optimization (RO). We achieve this through an alternating minimization-maximization procedure, in which the loss of the network is…

Machine Learning · Statistics 2018-05-07 Uri Shaham , Yutaro Yamada , Sahand Negahban