中文
相关论文

相关论文: Reducing Noise in GAN Training with Variance Reduc…

200 篇论文

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

机器学习 · 统计学 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

We consider the problem of training generative models with a Generative Adversarial Network (GAN). Although GANs can accurately model complex distributions, they are known to be difficult to train due to instabilities caused by a difficult…

机器学习 · 计算机科学 2017-06-13 Paulina Grnarova , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann , Andreas Krause

One of the frontier issues that severely hamper the development of automatic snore sound classification (ASSC) associates to the lack of sufficient supervised training data. To cope with this problem, we propose a novel data augmentation…

机器学习 · 计算机科学 2019-04-01 Zixing Zhang , Jing Han , Kun Qian , Christoph Janott , Yanan Guo , Bjoern Schuller

The most straightforward method to accelerate Stochastic Gradient Descent (SGD) computation is to distribute the randomly selected batch of inputs over multiple processors. To keep the distributed processors fully utilized requires…

机器学习 · 计算机科学 2020-01-06 Zhewei Yao , Amir Gholami , Daiyaan Arfeen , Richard Liaw , Joseph Gonzalez , Kurt Keutzer , Michael Mahoney

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

计算机视觉与模式识别 · 计算机科学 2019-05-24 Huaxia Wang , Chun-Nam Yu

Stochastic variance reduction has proven effective at accelerating first-order algorithms for solving convex finite-sum optimization tasks such as empirical risk minimization. Incorporating second-order information has proven helpful in…

最优化与控制 · 数学 2025-04-30 Michał Dereziński

The impressive success of Generative Adversarial Networks (GANs) is often overshadowed by the difficulties in their training. Despite the continuous efforts and improvements, there are still open issues regarding their convergence…

机器学习 · 计算机科学 2018-11-08 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou

Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of…

机器学习 · 计算机科学 2022-03-16 Uiwon Hwang , Heeseung Kim , Dahuin Jung , Hyemi Jang , Hyungyu Lee , Sungroh Yoon

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Daniel Michelsanti , Zheng-Hua Tan

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

机器学习 · 计算机科学 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs). Using the formalism of smooth two-player games we analyze the associated gradient vector field of GAN training objectives. Our…

机器学习 · 计算机科学 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

机器学习 · 统计学 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

机器学习 · 计算机科学 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

We fix a fundamental issue in the stochastic extragradient method by providing a new sampling strategy that is motivated by approximating implicit updates. Since the existing stochastic extragradient algorithm, called Mirror-Prox, of…

最优化与控制 · 数学 2021-02-22 Konstantin Mishchenko , Dmitry Kovalev , Egor Shulgin , Peter Richtárik , Yura Malitsky

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

机器学习 · 统计学 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

机器学习 · 计算机科学 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

机器学习 · 统计学 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

The wide applications of Generative adversarial networks benefit from the successful training methods, guaranteeing that an object function converges to the local minima. Nevertheless, designing an efficient and competitive training method…

机器学习 · 计算机科学 2021-11-11 Huiqing Qi , Fang Li , Shengli Tan , Xiangyun Zhang

Adversarial training of end-to-end (E2E) ASR systems using generative adversarial networks (GAN) has recently been explored for low-resource ASR corpora. GANs help to learn the true data representation through a two-player min-max game.…

音频与语音处理 · 电气工程与系统科学 2021-03-25 Md Akmal Haidar , Mehdi Rezagholizadeh

Speech enhancement is an essential task of improving speech quality in noise scenario. Several state-of-the-art approaches have introduced visual information for speech enhancement,since the visual aspect of speech is essentially unaffected…

音频与语音处理 · 电气工程与系统科学 2022-04-21 Xinmeng Xu , Yang Wang , Dongxiang Xu , Yiyuan Peng , Cong Zhang , Jie Jia , Binbin Chen