English
Related papers

Related papers: Continual Learning for Image Segmentation with Dyn…

200 papers

Incremental learning requires a model to continually learn new tasks from streaming data. However, traditional fine-tuning of a well-trained deep neural network on a new task will dramatically degrade performance on the old task -- a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Can Peng , Kun Zhao , Sam Maksoud , Meng Li , Brian C. Lovell

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, i.e. they perform…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Fabio Cermelli , Massimiliano Mancini , Samuel Rota Buló , Elisa Ricci , Barbara Caputo

Class incremental learning aims to enable models to learn from sequential, non-stationary data streams across different tasks without catastrophic forgetting. In class incremental semantic segmentation (CISS), the semantic content of image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiao Yu , Yan Fang , Yao Zhao , Yunchao Wei

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

Continual learning refers to a dynamical framework in which a model receives a stream of non-stationary data over time and must adapt to new data while preserving previously acquired knowledge. Unluckily, neural networks fail to meet these…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Umberto Cappellazzo , Daniele Falavigna , Alessio Brutti

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

Successful continual learning of new knowledge would enable intelligent systems to recognize more and more classes of objects. However, current intelligent systems often fail to correctly recognize previously learned classes of objects when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Changhong Zhong , Zhiying Cui , Ruixuan Wang , Wei-Shi Zheng

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

For future learning systems, incremental learning is desirable because it allows for: efficient resource usage by eliminating the need to retrain from scratch at the arrival of new data; reduced memory usage by preventing or limiting the…

Machine Learning · Computer Science 2022-10-12 Marc Masana , Xialei Liu , Bartlomiej Twardowski , Mikel Menta , Andrew D. Bagdanov , Joost van de Weijer

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis

Incremental learning represents a crucial task in aerial image processing, especially given the limited availability of large-scale annotated datasets. A major issue concerning current deep neural architectures is known as catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Edoardo Arnaudo , Fabio Cermelli , Antonio Tavera , Claudio Rossi , Barbara Caputo

Knowledge distillation is widely adopted in semantic segmentation to reduce the computation cost.The previous knowledge distillation methods for semantic segmentation focus on pixel-wise feature alignment and intra-class feature variation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Zhengbo Zhang , Chunluan Zhou , Zhigang Tu

Continual Semantic Segmentation (CSS) requires learning new classes without forgetting previously acquired knowledge, addressing the fundamental challenge of catastrophic forgetting in dense prediction tasks. However, existing CSS methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yifu Guo , Yuquan Lu , Wentao Zhang , Zishan Xu , Dexia Chen , Siyu Zhang , Yizhe Zhang , Ruixuan Wang

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

Continually learning to segment more and more types of image regions is a desired capability for many intelligent systems. However, such continual semantic segmentation suffers from the same catastrophic forgetting issue as in continual…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yiqiao Qiu , Yixing Shen , Zhuohao Sun , Yanchong Zheng , Xiaobin Chang , Weishi Zheng , Ruixuan Wang

Deep learning for medical imaging suffers from temporal and privacy-related restrictions on data availability. To still obtain viable models, continual learning aims to train in sequential order, as and when data is available. The main…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Marius Memmel , Camila Gonzalez , Anirban Mukhopadhyay

We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim to achieve better…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shipeng Yan , Jiangwei Xie , Xuming He

In recent years, knowledge distillation methods based on contrastive learning have achieved promising results on image classification and object detection tasks. However, in this line of research, we note that less attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiawei Fan , Chao Li , Xiaolong Liu , Meina Song , Anbang Yao

Continual semantic segmentation aims to learn new classes while maintaining the information from the previous classes. Although prior studies have shown impressive progress in recent years, the fairness concern in the continual semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Thanh-Dat Truong , Hoang-Quan Nguyen , Bhiksha Raj , Khoa Luu

Modern supervised semantic segmentation methods are usually finetuned based on the supervised or self-supervised models pre-trained on ImageNet. Recent work shows that transferring the knowledge from CLIP to semantic segmentation via prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Chaohui Yu , Qiang Zhou , Zhibin Wang , Fan Wang