中文
相关论文

相关论文: Continual Learning in Generative Adversarial Nets

200 篇论文

A recent technical breakthrough in the domain of machine learning is the discovery and the multiple applications of Generative Adversarial Networks (GANs). Those generative models are computationally demanding, as a GAN is composed of two…

机器学习 · 计算机科学 2021-04-14 Corentin Hardy , Erwan Le Merrer , Bruno Sericola

Modern deep neural networks are well known to be brittle in the face of unknown data instances and recognition of the latter remains a challenge. Although it is inevitable for continual-learning systems to encounter such unseen concepts,…

机器学习 · 计算机科学 2022-04-04 Martin Mundt , Iuliia Pliushch , Sagnik Majumder , Yongwon Hong , Visvanathan Ramesh

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

计算机视觉与模式识别 · 计算机科学 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

In this paper, we propose to equip Generative Adversarial Networks with the ability to produce direct energy estimates for samples.Specifically, we propose a flexible adversarial training framework, and prove this framework not only ensures…

机器学习 · 计算机科学 2017-02-27 Zihang Dai , Amjad Almahairi , Philip Bachman , Eduard Hovy , Aaron Courville

Deep generative models are rapidly becoming a common tool for researchers and developers. However, as exhaustively shown for the family of discriminative models, the test-time inference of deep neural networks cannot be fully controlled and…

机器学习 · 计算机科学 2019-05-15 Dario Pasquini , Marco Mingione , Massimo Bernaschi

Neural networks can achieve excellent results in a wide variety of applications. However, when they attempt to sequentially learn, they tend to learn the new task while catastrophically forgetting previous ones. We propose a model that…

机器学习 · 计算机科学 2020-12-18 Craig Atkinson , Brendan McCane , Lech Szymanski , Anthony Robins

In many real-world scenarios, data to train machine learning models become available over time. However, neural network models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon…

机器学习 · 计算机科学 2022-06-29 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

With the capacity of continual learning, humans can continuously acquire knowledge throughout their lifespan. However, computational systems are not, in general, capable of learning tasks sequentially. This long-standing challenge for deep…

机器学习 · 计算机科学 2022-08-05 Qihan Yang , Fan Feng , Rosa Chan

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Generative adversarial network (GAN) has been shown to be useful in various applications, such as image recognition, text processing and scientific computing, due its strong ability to learn complex data distributions. In this study, a…

地球物理 · 物理学 2021-09-14 Tianhao He , Dongxiao Zhang

Previous works on sequential learning address the problem of forgetting in discriminative models. In this paper we consider the case of generative models. In particular, we investigate generative adversarial networks (GANs) in the task of…

计算机视觉与模式识别 · 计算机科学 2019-09-24 Chenshen Wu , Luis Herranz , Xialei Liu , Yaxing Wang , Joost van de Weijer , Bogdan Raducanu

Continual (or "incremental") learning approaches are employed when additional knowledge or tasks need to be learned from subsequent batches or from streaming data. However these approaches are typically adversary agnostic, i.e., they do not…

机器学习 · 计算机科学 2021-02-17 Muhammad Umer , Robi Polikar

The ability of the Generative Adversarial Networks (GANs) framework to learn generative models mapping from simple latent distributions to arbitrarily complex data distributions has been demonstrated empirically, with compelling results…

机器学习 · 计算机科学 2017-04-05 Jeff Donahue , Philipp Krähenbühl , Trevor Darrell

Deep learning for medical imaging suffers from temporal and privacy-related restrictions on data availability. To still obtain viable models, continual learning aims to train in sequential order, as and when data is available. The main…

图像与视频处理 · 电气工程与系统科学 2021-07-27 Marius Memmel , Camila Gonzalez , Anirban Mukhopadhyay

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

机器学习 · 计算机科学 2023-04-06 Divya Saxena , Jiannong Cao

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

机器学习 · 计算机科学 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Deep generative models are a class of techniques that train deep neural networks to model the distribution of training samples. Research has fragmented into various interconnected approaches, each of which make trade-offs including…

机器学习 · 计算机科学 2022-03-29 Sam Bond-Taylor , Adam Leach , Yang Long , Chris G. Willcocks

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

机器学习 · 统计学 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

Uncovering the mechanisms behind long-term memory is one of the most fascinating open problems in neuroscience and artificial intelligence. Artificial associative memory networks have been used to formalize important aspects of biological…

机器学习 · 统计学 2023-11-20 Luca Ambrogioni

Continual learning seeks the human-like ability to accumulate new skills in machine intelligence. Its central challenge is catastrophic forgetting, whose underlying cause has not been fully understood for deep networks. In this paper, we…

机器学习 · 计算机科学 2025-10-13 Ze Peng , Jian Zhang , Jintao Guo , Lei Qi , Yang Gao , Yinghuan Shi