English
Related papers

Related papers: Is Discriminator a Good Feature Extractor?

200 papers

Feature learning forms the cornerstone for tackling challenging learning problems in domains such as speech, computer vision and natural language processing. In this paper, we consider a novel class of matrix and tensor-valued features,…

Machine Learning · Computer Science 2014-12-12 Majid Janzamin , Hanie Sedghi , Anima Anandkumar

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

We introduce generative adversarial models in which the discriminator is replaced by a calibrated (non-differentiable) classifier repeatedly enhanced by domain relevant features. The role of the classifier is to prove that the actual and…

Machine Learning · Computer Science 2019-10-08 Shahar Harel , Meir Maor , Amir Ronen

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

Machine Learning · Computer Science 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Generative adversarial networks are generative models that are capable of replicating the implicit probability distribution of the input data with high accuracy. Traditionally, GANs consist of a Generator and a Discriminator which interact…

Machine Learning · Computer Science 2022-11-15 Xin Wang

We introduce a novel approach for sequence decoding, Discriminative Adversarial Search (DAS), which has the desirable properties of alleviating the effects of exposure bias without requiring external metrics. Inspired by Generative…

Computation and Language · Computer Science 2020-09-01 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Generative adversarial networks have achieved remarkable performance on various tasks but suffer from training instability. Despite many training strategies proposed to improve training stability, this issue remains as a challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Faqiang Liu , Mingkun Xu , Guoqi Li , Jing Pei , Luping Shi , Rong Zhao

Distant supervision can effectively label data for relation extraction, but suffers from the noise labeling problem. Recent works mainly perform soft bag-level noise reduction strategies to find the relatively better samples in a sentence…

Computation and Language · Computer Science 2018-05-28 Pengda Qin , Weiran Xu , William Yang Wang

While generative adversarial networks (GANs) have been widely used in research on audio generation, the training of a GAN model is known to be unstable, time consuming, and data inefficient. Among the attempts to ameliorate the training…

Sound · Computer Science 2022-09-07 Yen-Tung Yeh , Bo-Yu Chen , Yi-Hsuan Yang

Generative adversarial networks are a novel method for statistical inference that have achieved much empirical success; however, the factors contributing to this success remain ill-understood. In this work, we attempt to analyze generative…

Machine Learning · Computer Science 2018-09-13 Shuang Liu , Kamalika Chaudhuri

The success of deep learning is partly attributed to the availability of massive data downloaded freely from the Internet. However, it also means that users' private data may be collected by commercial organizations without consent and used…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Qi Tian , Kun Kuang , Kelu Jiang , Furui Liu , Zhihua Wang , Fei Wu

Fairness-aware learning is increasingly important in data mining. Discrimination prevention aims to prevent discrimination in the training data before it is used to conduct predictive analysis. In this paper, we focus on fair data…

Machine Learning · Computer Science 2018-05-30 Depeng Xu , Shuhan Yuan , Lu Zhang , Xintao Wu

The ability of a classifier to recognize unknown inputs is important for many classification-based systems. We discuss the problem of simultaneous classification and novelty detection, i.e. determining whether an input is from the known set…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Mark Kliger , Shachar Fleishman

Softmax GAN is a novel variant of Generative Adversarial Network (GAN). The key idea of Softmax GAN is to replace the classification loss in the original GAN with a softmax cross-entropy loss in the sample space of one single batch. In the…

Machine Learning · Computer Science 2020-06-26 Min Lin

Abnormal crowd behaviour detection attracts a large interest due to its importance in video surveillance scenarios. However, the ambiguity and the lack of sufficient abnormal ground truth data makes end-to-end training of large deep…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Mahdyar Ravanbakhsh , Enver Sangineto , Moin Nabi , Nicu Sebe

We present an alternative perspective on the training of generative adversarial networks (GANs), showing that the training step for a GAN generator decomposes into two implicit subproblems. In the first, the discriminator provides new…

Machine Learning · Computer Science 2021-05-13 Romann M. Weber

Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Runmin Wu , Kunyao Zhang , Lijun Wang , Yue Wang , Pingping Zhang , Huchuan Lu , Yizhou Yu

Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs.…

Machine Learning · Computer Science 2023-12-29 Liang Hou , Qi Cao , Yige Yuan , Songtao Zhao , Chongyang Ma , Siyuan Pan , Pengfei Wan , Zhongyuan Wang , Huawei Shen , Xueqi Cheng

Recent works in Generative Adversarial Networks (GANs) are actively revisiting various data augmentation techniques as an effective way to prevent discriminator overfitting. It is still unclear, however, that which augmentations could…

Machine Learning · Computer Science 2021-03-18 Jongheon Jeong , Jinwoo Shin

Interpolations in the latent space of deep generative models is one of the standard tools to synthesize semantically meaningful mixtures of generated samples. As the generator function is non-linear, commonly used linear interpolations in…

Machine Learning · Computer Science 2022-03-03 Henning Petzka , Ted Kronvall , Cristian Sminchisescu