English
Related papers

Related papers: Generative-Discriminative Complementary Learning

200 papers

We study the problem of learning generative adversarial networks (GANs) for a rare class of an unlabeled dataset subject to a labeling budget. This problem is motivated from practical applications in domains including security (e.g.,…

Machine Learning · Computer Science 2022-03-22 Zinan Lin , Hao Liang , Giulia Fanti , Vyas Sekar

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

Recent work has shown that exploiting relations between labels improves the performance of multi-label classification. We propose a novel framework based on generative adversarial networks (GANs) to model label dependency. The discriminator…

Machine Learning · Computer Science 2018-11-13 Che-Ping Tsai , Hung-Yi Lee

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the…

Machine Learning · Computer Science 2014-11-06 Diederik P. Kingma , Danilo J. Rezende , Shakir Mohamed , Max Welling

It is argued that deep learning is efficient for data that is generated from hierarchal generative models. Examples of such generative models include wavelet scattering networks, functions of compositional structure, and deep rendering…

Machine Learning · Computer Science 2018-09-06 Elchanan Mossel

When trained on multimodal image datasets, normal Generative Adversarial Networks (GANs) are usually outperformed by class-conditional GANs and ensemble GANs, but conditional GANs is restricted to labeled datasets and ensemble GANs lack…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Haifeng Shi , Guanyu Cai , Yuqin Wang , Shaohua Shang , Lianghua He

The main challenge in continual learning for generative models is to effectively learn new target modes with limited samples while preserving previously learned ones. To this end, we introduce a new continual learning approach for…

Machine Learning · Computer Science 2023-09-26 Cat P. Le , Juncheng Dong , Ahmed Aloui , Vahid Tarokh

Deep generative models are becoming a cornerstone of modern machine learning. Recent work on conditional generative adversarial networks has shown that learning complex, high-dimensional distributions over natural images is within reach.…

Machine Learning · Computer Science 2019-05-15 Mario Lucic , Michael Tschannen , Marvin Ritter , Xiaohua Zhai , Olivier Bachem , Sylvain Gelly

We extend Generative Adversarial Networks (GANs) to the semi-supervised context by forcing the discriminator network to output class labels. We train a generative model G and a discriminator D on a dataset with inputs belonging to one of N…

Machine Learning · Statistics 2016-10-25 Augustus Odena

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Byungju Kim , Jaeyoung Lee , Kyungsu Kim , Sungjin Kim , Junmo Kim

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Anomaly detection is often considered a challenging field of machine learning due to the difficulty of obtaining anomalous samples for training and the need to obtain a sufficient amount of training data. In recent years, autoencoders have…

Machine Learning · Computer Science 2018-10-15 Yotam Intrator , Gilad Katz , Asaf Shabtai

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily overfit the label…

Computation and Language · Computer Science 2023-06-14 Yuchen Zhuang , Yue Yu , Lingkai Kong , Xiang Chen , Chao Zhang

Neural network based generative models with discriminative components are a powerful approach for semi-supervised learning. However, these techniques a) cannot account for model uncertainty in the estimation of the model's discriminative…

Machine Learning · Statistics 2017-06-30 Jonathan Gordon , José Miguel Hernández-Lobato

Lifelong learning is challenging for deep neural networks due to their susceptibility to catastrophic forgetting. Catastrophic forgetting occurs when a trained network is not able to maintain its ability to accomplish previously learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Mengyao Zhai , Lei Chen , Fred Tung , Jiawei He , Megha Nawhal , Greg Mori

Discriminative linear models are a popular tool in machine learning. These can be generally divided into two types: The first is linear classifiers, such as support vector machines, which are well studied and provide state-of-the-art…

Machine Learning · Computer Science 2012-07-02 Koby Crammer , Amir Globerson

In recent years, image classification, as a core task in computer vision, relies on high-quality labelled data, which restricts the wide application of deep learning models in practical scenarios. To alleviate the problem of insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jiyu Hu , Haijiang Zeng , Zhen Tian

Conditional Generative Adversarial Networks (cGAN) were designed to generate images based on the provided conditions, \eg, class-level distributions. However, existing methods have used the same generating architecture for all classes. This…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Peng Zhou , Lingxi Xie , Xiaopeng Zhang , Bingbing Ni , Qi Tian

Conditional image generation is the task of generating diverse images using class label information. Although many conditional Generative Adversarial Networks (GAN) have shown realistic results, such methods consider pairwise relations…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Minguk Kang , Jaesik Park