English
Related papers

Related papers: Self-Supervised GAN to Counter Forgetting

200 papers

Machine learning models, especially neural network (NN) classifiers, are widely used in many applications including natural language processing, computer vision and cybersecurity. They provide high accuracy under the assumption of…

Machine Learning · Computer Science 2019-03-08 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

Recent generative adversarial networks (GANs) are able to generate impressive photo-realistic images. However, controllable generation with GANs remains a challenging research problem. Achieving controllable generation requires semantically…

Machine Learning · Computer Science 2021-05-04 Grigorios G Chrysos , Jean Kossaifi , Zhiding Yu , Anima Anandkumar

The difficulty in obtaining labeled data relevant to a given task is among the most common and well-known practical obstacles to applying deep learning techniques to new or even slightly modified domains. The data volumes required by the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Jonathan Howe , Kyle Pula , Aaron A. Reite

Education is a right of all, however, every individual is different than others. Teachers in post-communism era discover inherent individualism to equally train all towards job market of fourth industrial revolution. We can consider…

Computation and Language · Computer Science 2025-02-06 Rossi Kamal

GANs have matured in recent years and are able to generate high-resolution, realistic images. However, the computational resources and the data required for the training of high-quality GANs are enormous, and the study of transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Héctor Laria , Yaxing Wang , Joost van de Weijer , Bogdan Raducanu

Sufficient supervised information is crucial for any machine learning models to boost performance. However, labeling data is expensive and sometimes difficult to obtain. Active learning is an approach to acquire annotations for data from a…

Machine Learning · Computer Science 2019-06-18 Quan Kong , Bin Tong , Martin Klinkigt , Yuki Watanabe , Naoto Akira , Tomokazu Murakami

Generative Adversarial Networks (GANs) coupled with self-supervised tasks have shown promising results in unconditional and semi-supervised image generation. We propose a self-supervised approach (LT-GAN) to improve the generation quality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Parth Patel , Nupur Kumari , Mayank Singh , Balaji Krishnamurthy

Semi-supervised learning has been gaining attention as it allows for performing image analysis tasks such as classification with limited labeled data. Some popular algorithms using Generative Adversarial Networks (GANs) for semi-supervised…

Machine Learning · Computer Science 2021-06-23 Ayaan Haque

Adversarially trained generative models (GANs) have recently achieved compelling image synthesis results. But despite early successes in using GANs for unsupervised representation learning, they have since been superseded by approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Jeff Donahue , Karen Simonyan

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

In recent years, Generative Adversarial Networks (GANs) have produced significantly improved results in speech enhancement (SE) tasks. They are difficult to train, however. In this work, we introduce several improvements to the GAN training…

Sound · Computer Science 2022-10-27 Vasily Zadorozhnyy , Qiang Ye , Kazuhito Koishida

Despite the success of generative adversarial networks (GANs) for image generation, the trade-off between visual quality and image diversity remains a significant issue. This paper achieves both aims simultaneously by improving the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Duhyeon Bang , Hyunjung Shim

Deep Learning has gained immense success in pushing today's artificial intelligence forward. To solve the challenge of limited labeled data in the supervised learning world, unsupervised learning has been proposed years ago while low…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 F. Liu , C. Liu , F. Bi

Combining Generative Adversarial Networks (GANs) with encoders that learn to encode data points has shown promising results in learning data representations in an unsupervised way. We propose a framework that combines an encoder and a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Tobias Hinz , Stefan Wermter

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations. However, learning from synthetic images may not achieve the desired performance due…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Ashish Shrivastava , Tomas Pfister , Oncel Tuzel , Josh Susskind , Wenda Wang , Russ Webb

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training…

Disordered Systems and Neural Networks · Physics 2022-12-12 Steven Durr , Youssef Mroueh , Yuhai Tu , Shenshen Wang

Generative Adversarial Networks (GANs) were intuitively and attractively explained under the perspective of game theory, wherein two involving parties are a discriminator and a generator. In this game, the task of the discriminator is to…

Machine Learning · Computer Science 2017-11-07 Trung Le , Tu Dinh Nguyen , Dinh Phung

Continual Learning research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or…

Machine Learning · Computer Science 2022-04-06 MohammadReza Davari , Nader Asadi , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky