中文
相关论文

相关论文: A Gauss-Newton Approach for Min-Max Optimization i…

200 篇论文

Generative adversarial networks (GANs) are one of the most popular methods for generating images today. While impressive results have been validated by visual inspection, a number of quantitative criteria have emerged only recently. We…

计算机视觉与模式识别 · 计算机科学 2018-07-26 Konstantin Shmelkov , Cordelia Schmid , Karteek Alahari

In this article, we introduce a new mode for training Generative Adversarial Networks (GANs). Rather than minimizing the distance of evidence distribution $\tilde{p}(x)$ and the generative distribution $q(x)$, we minimize the distance of…

机器学习 · 计算机科学 2018-10-30 Jianlin Su

Generative Adversarial Networks (GAN) training process, in most cases, apply Uniform or Gaussian sampling methods in the latent space, which probably spends most of the computation on examples that can be properly handled and easy to…

机器学习 · 计算机科学 2022-12-19 Shiyu Yi , Donglin Zhan , Wenqing Zhang , Denglin Jiang , Kang An , Hao Wang

Generative adversarial networks (GANs) provide state-of-the-art results in image generation. However, despite being so powerful, they still remain very challenging to train. This is in particular caused by their highly non-convex…

机器学习 · 计算机科学 2020-12-18 Ricard Durall , Avraam Chatzimichailidis , Peter Labus , Janis Keuper

We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative…

机器学习 · 计算机科学 2015-02-11 Yujia Li , Kevin Swersky , Richard Zemel

One of the training strategies of generative models is to minimize the Jensen--Shannon divergence between the model distribution and the data distribution. Since data distribution is unknown, generative adversarial networks (GANs) formulate…

机器学习 · 计算机科学 2023-02-22 Hiroki Naganuma , Hideaki Iiduka

Training generative adversarial networks requires balancing of delicate adversarial dynamics. Even with careful tuning, training may diverge or end up in a bad equilibrium with dropped modes. In this work, we improve CS-GAN with natural…

机器学习 · 计算机科学 2020-07-02 Yan Wu , Jeff Donahue , David Balduzzi , Karen Simonyan , Timothy Lillicrap

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

机器学习 · 统计学 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

We introduce a fast algorithm for entry-wise evaluation of the Gauss-Newton Hessian (GNH) matrix for the fully-connected feed-forward neural network. The algorithm has a precomputation step and a sampling step. While it generally requires…

数值分析 · 数学 2020-11-17 Chao Chen , Severin Reiz , Chenhan Yu , Hans-Joachim Bungartz , George Biros

Conventional meta-atom designs rely heavily on researchers' prior knowledge and trial-and-error searches using full-wave simulations, resulting in time-consuming and inefficient processes. Inverse design methods based on optimization…

机器学习 · 计算机科学 2023-12-11 Zezhou Zhang , Chuanchuan Yang , Yifeng Qin , Hao Feng , Jiqiang Feng , Hongbin Li

Computed tomography (CT) uses X-ray measurements taken from sensors around the body to generate tomographic images of the human body. Conventional reconstruction algorithms can be used if the X-ray data are adequately sampled and of high…

图像与视频处理 · 电气工程与系统科学 2021-12-28 Ruiwen Xing , Thomas Humphries , Dong Si

In this paper, we develop a variant of the well-known Gauss-Newton (GN) method to solve a class of nonconvex optimization problems involving low-rank matrix variables. As opposed to the standard GN method, our algorithm allows one to handle…

最优化与控制 · 数学 2020-10-27 Quoc Tran-Dinh

Generative adversarial networks (GANs) have demonstrated to be successful at generating realistic real-world images. In this paper we compare various GAN techniques, both supervised and unsupervised. The effects on training stability of…

机器学习 · 计算机科学 2018-03-28 Mathijs Pieters , Marco Wiering

We present Optimal Transport GAN (OT-GAN), a variant of generative adversarial nets minimizing a new metric measuring the distance between the generator distribution and the data distribution. This metric, which we call mini-batch energy…

机器学习 · 计算机科学 2018-03-16 Tim Salimans , Han Zhang , Alec Radford , Dimitris Metaxas

Image matting and image harmonization are two important tasks in image composition. Image matting, aiming to achieve foreground boundary details, and image harmonization, aiming to make the background compatible with the foreground, are…

计算机视觉与模式识别 · 计算机科学 2021-08-16 Xuqian Ren , Yifan Liu , Chunlei Song

This paper addresses the problem of remote sensing image pan-sharpening from the perspective of generative adversarial learning. We propose a novel deep neural network based method named PSGAN. To the best of our knowledge, this is one of…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Qingjie Liu , Huanyu Zhou , Qizhi Xu , Xiangyu Liu , Yunhong Wang

In this paper, we propose a novel normalization method called gradient normalization (GN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike existing work such as gradient…

机器学习 · 计算机科学 2021-10-12 Yi-Lun Wu , Hong-Han Shuai , Zhi-Rui Tam , Hong-Yu Chiu

The GANs promote an adversarive game to approximate complex and jointed example probability. The networks driven by noise generate fake examples to approximate realistic data distributions. Later the conditional GAN merges prior-conditions…

计算机视觉与模式识别 · 计算机科学 2017-07-18 Meng Wang , Huafeng Li , Fang Li

Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes…

计算机视觉与模式识别 · 计算机科学 2020-10-08 Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , Timo Aila

We propose a novel modular inference approach combining two different generative models -- generative adversarial networks (GAN) and normalizing flows -- to approximate the posterior distribution of physics-based Bayesian inverse problems…

计算工程、金融与科学 · 计算机科学 2023-10-10 Agnimitra Dasgupta , Dhruv V Patel , Deep Ray , Erik A Johnson , Assad A Oberai