English
Related papers

Related papers: A Self-Training Method for Semi-Supervised GANs

200 papers

The difficulty in obtaining labeled data relevant to a given task is among the most common and well-known practical obstacles to applying deep learning techniques to new or even slightly modified domains. The data volumes required by the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Jonathan Howe , Kyle Pula , Aaron A. Reite

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

Machine Learning · Computer Science 2023-04-06 Divya Saxena , Jiannong Cao

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

Pre-training and self-training are two approaches to semi-supervised learning. The comparison between pre-training and self-training has been explored. However, the previous works led to confusing findings: self-training outperforms…

Computation and Language · Computer Science 2024-09-05 Yiheng Wang , Jiayu Lin , Zuoquan Lin

Insufficient training data is a major bottleneck for most deep learning practices, not least in medical imaging where data is difficult to collect and publicly available datasets are scarce due to ethics and privacy. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Gabriel Eilertsen , Apostolia Tsirikoglou , Claes Lundström , Jonas Unger

Ever since its debut, generative adversarial networks (GANs) have attracted tremendous amount of attention. Over the past years, different variations of GANs models have been developed and tailored to different applications in practice.…

Mathematical Finance · Quantitative Finance 2021-09-10 Haoyang Cao , Xin Guo

Despite remarkable performance in producing realistic samples, Generative Adversarial Networks (GANs) often produce low-quality samples near low-density regions of the data manifold, e.g., samples of minor groups. Many techniques have been…

Machine Learning · Computer Science 2021-10-28 Jinhee Lee , Haeri Kim , Youngkyu Hong , Hye Won Chung

Deep neural networks (DNNs) have greatly contributed to the performance gains in semantic segmentation. Nevertheless, training DNNs generally requires large amounts of pixel-level labeled data, which is expensive and time-consuming to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yonghao Xu , Fengxiang He , Bo Du , Dacheng Tao , Liangpei Zhang

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Recent work has demonstrated that neural networks are vulnerable to adversarial examples. To escape from the predicament, many works try to harden the model in various ways, in which adversarial training is an effective way which learns…

Machine Learning · Computer Science 2020-02-04 Kejiang Chen , Hang Zhou , Yuefeng Chen , Xiaofeng Mao , Yuhong Li , Yuan He , Hui Xue , Weiming Zhang , Nenghai Yu

Self-supervised (SS) learning is a powerful approach for representation learning using unlabeled data. Recently, it has been applied to Generative Adversarial Networks (GAN) training. Specifically, SS tasks were proposed to address the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-09 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Linxiao Yang , Ngai-Man Cheung

Self-training is one of the earliest and simplest semi-supervised methods. The key idea is to augment the original labeled dataset with unlabeled data paired with the model's prediction (i.e. the pseudo-parallel data). While self-training…

Machine Learning · Computer Science 2020-10-20 Junxian He , Jiatao Gu , Jiajun Shen , Marc'Aurelio Ranzato

Training effective Generative Adversarial Networks (GANs) requires large amounts of training data, without which the trained models are usually sub-optimal with discriminator over-fitting. Several prior studies address this issue by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Kaiwen Cui , Jiaxing Huang , Zhipeng Luo , Gongjie Zhang , Fangneng Zhan , Shijian Lu

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations. However, learning from synthetic images may not achieve the desired performance due…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Ashish Shrivastava , Tomas Pfister , Oncel Tuzel , Josh Susskind , Wenda Wang , Russ Webb

Generative Adversarial Networks (GAN) have gained a lot of popularity from their introduction in 2014 till present. Research on GAN is rapidly growing and there are many variants of the original GAN focusing on various aspects of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Michal Uricar , Pavel Krizek , David Hurych , Ibrahim Sobh , Senthil Yogamani , Patrick Denny

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

In semi-supervised learning, virtual adversarial training (VAT) approach is one of the most attractive method due to its intuitional simplicity and powerful performances. VAT finds a classifier which is robust to data perturbation toward…

Machine Learning · Statistics 2019-09-17 Dongha Kim , Yongchan Choi , Yongdai Kim

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora