English
Related papers

Related papers: PILOT: A Data-Free Continual Learning Approach for…

200 papers

The continual learning (CL) paradigm aims to enable neural networks to learn tasks continually in a sequential fashion. The fundamental challenge in this learning paradigm is catastrophic forgetting previously learned tasks when the model…

Machine Learning · Computer Science 2021-04-15 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Even though deep neural networks have shown tremendous success in countless applications, explaining model behaviour or predictions is an open research problem. In this paper, we address this issue by employing a simple yet effective method…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ryan Benkert , Oluwaseun Joseph Aribido , Ghassan AlRegib

Continual learning is the ability to acquire new knowledge without forgetting the previously learned one, assuming no further access to past training data. Neural network approximators trained with gradient descent are known to fail in this…

Machine Learning · Computer Science 2021-11-05 Rodrigue Siry

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

During the last few years, continual learning (CL) strategies for image classification and segmentation have been widely investigated designing innovative solutions to tackle catastrophic forgetting, like knowledge distillation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Elena Camuffo , Simone Milani

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci

In the present era of deep learning, continual learning research is mainly focused on mitigating forgetting when training a neural network with stochastic gradient descent on a non-stationary stream of data. On the other hand, in the more…

Machine Learning · Computer Science 2024-05-30 Soochan Lee , Hyeonseong Jeon , Jaehyeon Son , Gunhee Kim

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, i.e. they perform…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Fabio Cermelli , Massimiliano Mancini , Samuel Rota Buló , Elisa Ricci , Barbara Caputo

Two-branch network architecture has shown its efficiency and effectiveness in real-time semantic segmentation tasks. However, direct fusion of high-resolution details and low-frequency context has the drawback of detailed features being…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jiacong Xu , Zixiang Xiong , Shankar P. Bhattacharyya

Panoptic segmentation, combining semantic and instance segmentation, stands as a cutting-edge computer vision task. Despite recent progress with deep learning models, the dynamic nature of real-world applications necessitates continual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Beomyoung Kim , Joonsang Yu , Sung Ju Hwang

Incremental learning of semantic segmentation has emerged as a promising strategy for visual scene interpretation in the open- world setting. However, it remains challenging to acquire novel classes in an online fashion for the segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Shipeng Yan , Jiale Zhou , Jiangwei Xie , Songyang Zhang , Xuming He

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

Neural and Evolutionary Computing · Computer Science 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang

Semantic segmentation networks are usually pre-trained once and not updated during deployment. As a consequence, misclassifications commonly occur if the distribution of the training data deviates from the one encountered during the robot's…

Robotics · Computer Science 2023-02-15 Jonas Frey , Hermann Blum , Francesco Milano , Roland Siegwart , Cesar Cadena

Continual learning has been a major problem in the deep learning community, where the main challenge is how to effectively learn a series of newly arriving tasks without forgetting the knowledge of previous tasks. Initiated by Learning…

Machine Learning · Computer Science 2021-07-06 Jong-Yeong Kim , Dong-Wan Choi

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Recent efforts in multi-domain learning for semantic segmentation attempt to learn multiple geographical datasets in a universal, joint model. A simple fine-tuning experiment performed sequentially on three popular road scene segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Prachi Garg , Rohit Saluja , Vineeth N Balasubramanian , Chetan Arora , Anbumani Subramanian , C. V. Jawahar

Continual semantic segmentation aims to learn new classes while maintaining the information from the previous classes. Although prior studies have shown impressive progress in recent years, the fairness concern in the continual semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Thanh-Dat Truong , Hoang-Quan Nguyen , Bhiksha Raj , Khoa Luu