English
Related papers

Related papers: Is Discriminator a Good Feature Extractor?

200 papers

In recent years, Generative Adversarial Networks (GANs) have become a hot topic among researchers and engineers that work with deep learning. It has been a ground-breaking technique which can generate new pieces of content of data in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Parthak Mehta , Sarthak Mishra , Nikhil Chouhan , Neel Pethani , Ishani Saha

Within the framework of generative adversarial networks (GANs), we propose objectives that task the discriminator for self-supervised representation learning via additional structural modeling responsibilities. In combination with an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xiao Zhang , Michael Maire

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

GANs involve training two networks in an adversarial game, where each network's task depends on its adversary. Recently, several works have framed GAN training as an online or continual learning problem. We focus on the discriminator, which…

Machine Learning · Computer Science 2018-12-06 Ting Chen , Xiaohua Zhai , Neil Houlsby

Recently introduced generative adversarial network (GAN) has been shown numerous promising results to generate realistic samples. The essential task of GAN is to control the features of samples generated from a random distribution. While…

Machine Learning · Computer Science 2019-04-02 Minhyeok Lee , Junhee Seok

Despite excellent performance in image generation, Generative Adversarial Networks (GANs) are notorious for its requirements of enormous storage and intensive computation. As an awesome ''performance maker'', knowledge distillation is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Tie Hu , Mingbao Lin , Lizhou You , Fei Chao , Rongrong Ji

Despite Generative Adversarial Networks (GANs) have been widely used in various image-to-image translation tasks, they can be hardly applied on mobile devices due to their heavy computation and storage cost. Traditional network compression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hanting Chen , Yunhe Wang , Han Shu , Changyuan Wen , Chunjing Xu , Boxin Shi , Chao Xu , Chang Xu

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

Transformer models have recently attracted much interest from computer vision researchers and have since been successfully employed for several problems traditionally addressed with convolutional neural networks. At the same time, image…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ricard Durall , Stanislav Frolov , Jörn Hees , Federico Raue , Franz-Josef Pfreundt , Andreas Dengel , Janis Keupe

When formulated as an unsupervised learning problem, anomaly detection often requires a model to learn the distribution of normal data. Previous works apply Generative Adversarial Networks (GANs) to anomaly detection tasks and show good…

Machine Learning · Computer Science 2021-06-15 Xu Han , Xiaohui Chen , Li-Ping Liu

Generative Adversarial Networks (GANs) have known a tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open…

Machine Learning · Computer Science 2022-01-31 Sylvain Lamprier , Thomas Scialom , Antoine Chaffin , Vincent Claveau , Ewa Kijak , Jacopo Staiano , Benjamin Piwowarski

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

We propose to incorporate adversarial dropout in generative multi-adversarial networks, by omitting or dropping out, the feedback of each discriminator in the framework with some probability at the end of each batch. Our approach forces the…

Machine Learning · Computer Science 2020-01-22 Gonçalo Mordido , Haojin Yang , Christoph Meinel

Recent work has shown that exploiting relations between labels improves the performance of multi-label classification. We propose a novel framework based on generative adversarial networks (GANs) to model label dependency. The discriminator…

Machine Learning · Computer Science 2018-11-13 Che-Ping Tsai , Hung-Yi Lee

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

Transformer becomes prevalent in computer vision, especially for high-level vision tasks. However, adopting Transformer in the generative adversarial network (GAN) framework is still an open yet challenging problem. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Rui Xu , Xiangyu Xu , Kai Chen , Bolei Zhou , Chen Change Loy

The key objective of Generative Adversarial Networks (GANs) is to generate new data with the same statistics as the provided training data. However, multiple recent works show that state-of-the-art architectures yet struggle to achieve this…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Katja Schwarz , Yiyi Liao , Andreas Geiger

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

We propose to tackle the mode collapse problem in generative adversarial networks (GANs) by using multiple discriminators and assigning a different portion of each minibatch, called microbatch, to each discriminator. We gradually change…

Machine Learning · Computer Science 2020-01-13 Gonçalo Mordido , Haojin Yang , Christoph Meinel

Recent work has shown that state-of-the-art models are highly vulnerable to adversarial perturbations of the input. We propose cowboy, an approach to detecting and defending against adversarial attacks by using both the discriminator and…

Machine Learning · Statistics 2018-05-29 Gokula Krishnan Santhanam , Paulina Grnarova