中文
相关论文

相关论文: EXACFS -- A CIL Method to mitigate Catastrophic Fo…

200 篇论文

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

机器学习 · 计算机科学 2023-06-22 Depeng Li , Zhigang Zeng

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

计算机视觉与模式识别 · 计算机科学 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox

The intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which interferes with remembering past knowledge. To mitigate…

机器学习 · 计算机科学 2026-02-03 Nghia D. Nguyen , Hieu Trung Nguyen , Ang Li , Hoang Pham , Viet Anh Nguyen , Khoa D. Doan

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Although deep neural networks perform extremely well in controlled environments, they fail in real-world scenarios where data isn't available all at once, and the model must adapt to a new data distribution that may or may not follow the…

机器学习 · 计算机科学 2026-03-17 Vaishnavi Nagabhushana , Kartikay Agrawal , Ayon Borthakur

Incremental learning remains a critical challenge in machine learning, as models often struggle with catastrophic forgetting -the tendency to lose previously acquired knowledge when learning new information. These challenges are even more…

Deep neural networks (DNNs) often suffer from "catastrophic forgetting" during incremental learning (IL) --- an abrupt degradation of performance on the original set of classes when the training objective is adapted to a newly added set of…

计算机视觉与模式识别 · 计算机科学 2020-01-17 Junting Zhang , Jie Zhang , Shalini Ghosh , Dawei Li , Serafettin Tasci , Larry Heck , Heming Zhang , C. -C. Jay Kuo

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

机器学习 · 计算机科学 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

计算机视觉与模式识别 · 计算机科学 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

Human being and different species of animals having the skills to gather, transferring knowledge, processing, fine-tune and generating information throughout their lifetime. The ability of learning throughout their lifespan is referred as…

机器学习 · 计算机科学 2024-05-15 Ashutosh Kumar , Sonali Agarwal , D Jude Hemanth

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

计算机视觉与模式识别 · 计算机科学 2020-07-31 Ali Ayub , Alan Wagner

The human brain is capable of learning tasks sequentially mostly without forgetting. However, deep neural networks (DNNs) suffer from catastrophic forgetting when learning one task after another. We address this challenge considering a…

机器学习 · 计算机科学 2023-01-18 Aleksandr Dekhovich , David M. J. Tax , Marcel H. F. Sluiter , Miguel A. Bessa

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Deep neural networks (DNNs) have been applied in class incremental learning, which aims to solve common real-world problems of learning new classes continually. One drawback of standard DNNs is that they are prone to catastrophic…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Bowen Zhao , Xi Xiao , Guojun Gan , Bin Zhang , Shutao Xia

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

机器学习 · 计算机科学 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent remarkable progress in state-of-the-art deep learning, deep…

机器学习 · 计算机科学 2019-05-22 Xilai Li , Yingbo Zhou , Tianfu Wu , Richard Socher , Caiming Xiong

We investigate the performance of DNNs when trained on class-incremental visual problems consisting of initial training, followed by retraining with added visual classes. Catastrophic forgetting (CF) behavior is measured using a new…

机器学习 · 计算机科学 2019-05-21 B. Pfülb , A. Gepperth , S. Abdullah , A. Kilian
‹ 上一页 1 2 3 10 下一页 ›