中文
相关论文

相关论文: Continual Learning of Personalized Generative Face…

200 篇论文

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

机器学习 · 计算机科学 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Learning new tasks accumulatively without forgetting remains a critical challenge in continual learning. Generative experience replay addresses this challenge by synthesizing pseudo-data points for past learned tasks and later replaying…

机器学习 · 计算机科学 2023-10-09 Zizhao Hu , Mohammad Rostami

Continual Learning research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or…

机器学习 · 计算机科学 2022-04-06 MohammadReza Davari , Nader Asadi , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

机器学习 · 计算机科学 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

Previous works on sequential learning address the problem of forgetting in discriminative models. In this paper we consider the case of generative models. In particular, we investigate generative adversarial networks (GANs) in the task of…

计算机视觉与模式识别 · 计算机科学 2019-09-24 Chenshen Wu , Luis Herranz , Xialei Liu , Yaxing Wang , Joost van de Weijer , Bogdan Raducanu

The problem of catastrophic forgetting occurs in deep learning models trained on multiple databases in a sequential manner. Recently, generative replay mechanisms (GRM), have been proposed to reproduce previously learned knowledge aiming to…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Fei Ye , Adrian G. Bors

Lifelong learning is challenging for deep neural networks due to their susceptibility to catastrophic forgetting. Catastrophic forgetting occurs when a trained network is not able to maintain its ability to accomplish previously learned…

计算机视觉与模式识别 · 计算机科学 2019-08-23 Mengyao Zhai , Lei Chen , Fred Tung , Jiawei He , Megha Nawhal , Greg Mori

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

计算机视觉与模式识别 · 计算机科学 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

计算机视觉与模式识别 · 计算机科学 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Artificial learning systems aspire to mimic human intelligence by continually learning from a stream of tasks without forgetting past knowledge. One way to enable such learning is to store past experiences in the form of input examples in…

机器学习 · 计算机科学 2022-10-13 Gobinda Saha , Kaushik Roy

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and…

机器学习 · 统计学 2021-03-02 Binh Tang , David S. Matteson

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

机器学习 · 计算机科学 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Continual learning seeks to enable deep learners to train on a series of tasks of unknown length without suffering from the catastrophic forgetting of previous tasks. One effective solution is replay, which involves storing few previous…

机器学习 · 计算机科学 2023-08-04 Daniel Brignac , Niels Lobo , Abhijit Mahalanobis

Continual learning aims to learn new tasks without forgetting previously learned ones. We hypothesize that representations learned to solve each task in a sequence have a shared structure while containing some task-specific properties. We…

机器学习 · 计算机科学 2020-07-22 Sayna Ebrahimi , Franziska Meier , Roberto Calandra , Trevor Darrell , Marcus Rohrbach

The catastrophic forgetting of previously learnt classes is one of the main obstacles to the successful development of a reliable and accurate generative continual learning model. When learning new classes, the internal representation of…

机器学习 · 计算机科学 2021-11-24 Jack Millichamp , Xi Chen

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

机器学习 · 计算机科学 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

机器学习 · 计算机科学 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

机器学习 · 计算机科学 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

机器学习 · 计算机科学 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Continual Learning is an unresolved challenge, whose relevance increases when considering modern applications. Unlike the human brain, trained deep neural networks suffer from a phenomenon called catastrophic forgetting, wherein they…

机器学习 · 计算机科学 2025-02-18 Shahar Shaul-Ariel , Daphna Weinshall