English
Related papers

Related papers: Good Semi-supervised Learning that Requires a Bad …

200 papers

In traditional generative modeling, good data representation is very often a base for a good machine learning model. It can be linked to good representations encoding more explanatory factors that are hidden in the original data. With the…

Machine Learning · Computer Science 2019-04-01 Maciej Zamorski , Adrian Zdobylak , Maciej Zięba , Jerzy Świątek

Within the framework of generative adversarial networks (GANs), we propose objectives that task the discriminator for self-supervised representation learning via additional structural modeling responsibilities. In combination with an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xiao Zhang , Michael Maire

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

In this paper we present a method for learning a discriminative classifier from unlabeled or partially labeled data. Our approach is based on an objective function that trades-off mutual information between observed examples and their…

Machine Learning · Statistics 2016-05-03 Jost Tobias Springenberg

Recently, transformation-based self-supervised learning has been applied to generative adversarial networks (GANs) to mitigate catastrophic forgetting in the discriminator by introducing a stationary learning environment. However, the…

Machine Learning · Computer Science 2022-01-19 Liang Hou , Huawei Shen , Qi Cao , Xueqi Cheng

Generative adversarial networks (GANs) can implicitly learn rich distributions over images, audio, and data which are hard to model with an explicit likelihood. We present a practical Bayesian formulation for unsupervised and…

Machine Learning · Statistics 2017-11-09 Yunus Saatchi , Andrew Gordon Wilson

Generative Adversarial Nets (GANs) have shown promise in image generation and semi-supervised learning (SSL). However, existing GANs in SSL have two problems: (1) the generator and the discriminator (i.e. the classifier) may not be optimal…

Machine Learning · Computer Science 2017-11-07 Chongxuan Li , Kun Xu , Jun Zhu , Bo Zhang

In recent times, many of the breakthroughs in various vision-related tasks have revolved around improving learning of deep models; these methods have ranged from network architectural improvements such as Residual Networks, to various forms…

Machine Learning · Statistics 2018-05-15 Yan Zuo , Gil Avraham , Tom Drummond

Generative adversarial networks (GAN) are a powerful subclass of generative models. Despite a very rich research activity leading to numerous interesting GAN algorithms, it is still very hard to assess which algorithm(s) perform better than…

Machine Learning · Statistics 2018-10-30 Mario Lucic , Karol Kurach , Marcin Michalski , Sylvain Gelly , Olivier Bousquet

Generative adversarial networks are generative models that are capable of replicating the implicit probability distribution of the input data with high accuracy. Traditionally, GANs consist of a Generator and a Discriminator which interact…

Machine Learning · Computer Science 2022-11-15 Xin Wang

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the…

Machine Learning · Computer Science 2014-11-06 Diederik P. Kingma , Danilo J. Rezende , Shakir Mohamed , Max Welling

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

Generative adversarial networks (GANs) have been remarkably successful in learning complex high dimensional real word distributions and generating realistic samples. However, they provide limited control over the generation process.…

Machine Learning · Computer Science 2020-10-27 Arunava Chakraborty , Rahul Ragesh , Mahir Shah , Nipun Kwatra

Generative adversarial networks (GANs) are deep neural networks that allow us to sample from an arbitrary probability distribution without explicitly estimating the distribution. There is a generator that takes a latent vector as input and…

Machine Learning · Computer Science 2021-06-22 Alper Ahmetoğlu , Ethem Alpaydın

In this note, we point out a basic link between generative adversarial (GA) training and binary classification -- any powerful discriminator essentially computes an (f-)divergence between real and generated samples. The result, repeatedly…

Machine Learning · Computer Science 2017-09-06 Akshay Balsubramani

This paper first presents a theory for generative adversarial methods that does not rely on the traditional minimax formulation. It shows that with a strong discriminator, a good generator can be learned so that the KL divergence between…

Machine Learning · Statistics 2018-06-11 Rie Johnson , Tong Zhang

One of the most interesting challenges in Artificial Intelligence is to train conditional generators which are able to provide labeled adversarial samples drawn from a specific distribution. In this work, a new framework is presented to…

Image and Video Processing · Electrical Eng. & Systems 2018-06-20 Shabab Bazrafkan , Hossein Javidnia , Peter Corcoran

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He