English
Related papers

Related papers: Inception Score, Label Smoothing, Gradient Vanishi…

200 papers

Deep generative models (DGMs) of images are now sufficiently mature that they produce nearly photorealistic samples and obtain scores similar to the data distribution on heuristics such as Frechet Inception Distance (FID). These results,…

Machine Learning · Computer Science 2019-10-29 Suman Ravuri , Oriol Vinyals

Sufficient supervised information is crucial for any machine learning models to boost performance. However, labeling data is expensive and sometimes difficult to obtain. Active learning is an approach to acquire annotations for data from a…

Machine Learning · Computer Science 2019-06-18 Quan Kong , Bin Tong , Martin Klinkigt , Yuki Watanabe , Naoto Akira , Tomokazu Murakami

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as…

Machine Learning · Statistics 2019-06-18 Han Zhang , Ian Goodfellow , Dimitris Metaxas , Augustus Odena

Generative Adversarial Networks (GANs) have achieved great success in generating realistic images. Most of these are conditional models, although acquisition of class labels is expensive and time-consuming in practice. To reduce the…

Machine Learning · Computer Science 2019-02-20 Ce Wang , Zhangling Chen , Kun Shang

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

Recently, transformation-based self-supervised learning has been applied to generative adversarial networks (GANs) to mitigate catastrophic forgetting in the discriminator by introducing a stationary learning environment. However, the…

Machine Learning · Computer Science 2022-01-19 Liang Hou , Huawei Shen , Qi Cao , Xueqi Cheng

This work is an update of a previous paper on the same topic published a few years ago. With the dramatic progress in generative modeling, a suite of new quantitative and qualitative techniques to evaluate models has emerged. Although some…

Machine Learning · Computer Science 2021-10-05 Ali Borji

We show that variational learning naturally induces an adaptive label smoothing where label noise is specialized for each example. Such label-smoothing is useful to handle examples with labeling errors and distribution shifts, but designing…

Machine Learning · Computer Science 2025-03-05 Sin-Han Yang , Zhedong Liu , Gian Maria Marconi , Mohammad Emtiyaz Khan

Identifying anomalies refers to detecting samples that do not resemble the training data distribution. Many generative models have been used to find anomalies, and among them, generative adversarial network (GAN)-based approaches are…

Machine Learning · Computer Science 2022-01-03 Laya Rafiee Sevyeri , Thomas Fevens

We introduce a novel approach for batch selection in Stochastic Gradient Descent (SGD) training, leveraging combinatorial bandit algorithms. Our methodology focuses on optimizing the learning process in the presence of label noise, a…

Machine Learning · Computer Science 2023-11-02 Michal Lisicki , Mihai Nica , Graham W. Taylor

We propose discriminative neighborhood smoothing of generative anomaly scores for anomalous sound detection. While the discriminative approach is known to achieve better performance than generative approaches often, we have found that it…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-19 Takuya Fujimura , Keisuke Imoto , Tomoki Toda

Generative adversarial network (GAN) is among the most popular deep learning models for learning complex data distributions. However, training a GAN is known to be a challenging task. This is often attributed to the lack of correlation…

Machine Learning · Computer Science 2020-12-15 Sahil Sidheekh , Aroof Aimen , Vineet Madan , Narayanan C. Krishnan

Softmax GAN is a novel variant of Generative Adversarial Network (GAN). The key idea of Softmax GAN is to replace the classification loss in the original GAN with a softmax cross-entropy loss in the sample space of one single batch. In the…

Machine Learning · Computer Science 2020-06-26 Min Lin

Synthesizing high quality saliency maps from noisy images is a challenging problem in computer vision and has many practical applications. Samples generated by existing techniques for saliency detection cannot handle the noise perturbations…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Prerana Mukherjee , Manoj Sharma , Megh Makwana , Ajay Pratap Singh , Avinash Upadhyay , Akkshita Trivedi , Brejesh Lall , Santanu Chaudhury

Vertical Federated Learning (VFL) has emerged as a promising paradigm for collaborative model training across distributed feature spaces, which enables privacy-preserving learning without sharing raw data. However, recent studies have…

Cryptography and Security · Computer Science 2026-04-14 Zeyu Yan , Yanfei Yao , Xuanbing Wen , Shixiong Zhang , Juli Zhang , Kai Fan

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Machine Learning · Statistics 2019-08-05 Sunil Thulasidasan , Tanmoy Bhattacharya , Jeff Bilmes , Gopinath Chennupati , Jamal Mohd-Yusof

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

Text generative models trained via Maximum Likelihood Estimation (MLE) suffer from the notorious exposure bias problem, and Generative Adversarial Networks (GANs) are shown to have potential to tackle this problem. Existing language GANs…

Computation and Language · Computer Science 2023-07-19 Da Ren , Qing Li

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

Machine Learning · Statistics 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo