English
Related papers

Related papers: Continual Learning for Image Segmentation with Dyn…

200 papers

In this work, we focus on continual semantic segmentation (CSS), where segmentation networks are required to continuously learn new classes without erasing knowledge of previously learned ones. Although storing images of old classes and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hongmei Yin , Tingliang Feng , Fan Lyu , Fanhua Shang , Hongying Liu , Wei Feng , Liang Wan

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Knowledge distillation (KD) is a valuable yet challenging approach that enhances a compact student network by learning from a high-performance but cumbersome teacher model. However, previous KD methods for image restoration overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yunshuai Zhou , Junbo Qiao , Jincheng Liao , Wei Li , Simiao Li , Jiao Xie , Yunhang Shen , Jie Hu , Shaohui Lin

To address the problem of catastrophic forgetting due to the invisibility of old categories in sequential input, existing work based on relatively simple categorization tasks has made some progress. In contrast, video captioning is a more…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Huiyu Xiong , Lanxiao Wang , Heqian Qiu , Taijin Zhao , Benliu Qiu , Hongliang Li

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most existing object…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xialei Liu , Hao Yang , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

In many real-world scenarios, data to train machine learning models become available over time. However, neural network models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon…

Machine Learning · Computer Science 2022-06-29 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Incremental or continual learning has been extensively studied for image classification tasks to alleviate catastrophic forgetting, a phenomenon that earlier learned knowledge is forgotten when learning new concepts. For class incremental…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Zekang Zhang , Guangyu Gao , Zhiyuan Fang , Jianbo Jiao , Yunchao Wei

Humans are capable of acquiring new knowledge and transferring learned knowledge into different domains, incurring a small forgetting. The same ability, called Continual Learning, is challenging to achieve when operating with neural…

Machine Learning · Computer Science 2024-05-24 Jary Pomponi , Alessio Devoto , Simone Scardapane

In spite of remarkable success of the convolutional neural networks on semantic segmentation, they suffer from catastrophic forgetting: a significant performance drop for the already learned classes when new classes are added on the data,…

Machine Learning · Computer Science 2019-11-28 Onur Tasar , Yuliya Tarabalka , Pierre Alliez

An ultimate objective in continual learning is to preserve knowledge learned in preceding tasks while learning new tasks. To mitigate forgetting prior knowledge, we propose a novel knowledge distillation technique that takes into the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Kaushik Roy , Christian Simon , Peyman Moghadam , Mehrtash Harandi

The deep learning revolution has strongly impacted low-level image processing tasks such as style/domain transfer, enhancement/restoration, and visual quality assessments. Despite often being treated separately, the aforementioned tasks…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Abhinau K. Venkataramanan , Cosmin Stejerean , Ioannis Katsavounidis , Hassene Tmar , Alan C. Bovik

Continuously learning new classes without catastrophic forgetting is a challenging problem for on-device environmental sound classification given the restrictions on computation resources (e.g., model size, running memory). To address this…

Sound · Computer Science 2022-07-19 Yang Xiao , Xubo Liu , James King , Arshdeep Singh , Eng Siong Chng , Mark D. Plumbley , Wenwu Wang

Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ke Yu , Stephen Albro , Giulia DeSalvo , Suraj Kothawade , Abdullah Rashwan , Sasan Tavakkol , Kayhan Batmanghelich , Xiaoqi Yin

Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image classification in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Motasem Alfarra , Zhipeng Cai , Adel Bibi , Bernard Ghanem , Matthias Müller

Semantic segmentation plays a crucial role in enabling comprehensive scene understanding for robotic systems. However, generating annotations is challenging, requiring labels for every pixel in an image. In scenarios like autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Mostafa ElAraby , Ali Harakeh , Liam Paull

Continual learning aims to rapidly and continually learn the current task from a sequence of tasks. Compared to other kinds of methods, the methods based on experience replay have shown great advantages to overcome catastrophic forgetting.…

Machine Learning · Computer Science 2022-09-14 Ya-nan Han , Jian-wei Liu

The use of episodic memory in continual learning has demonstrated effectiveness for alleviating catastrophic forgetting. In recent studies, gradient-based approaches have been developed to make more efficient use of compact episodic memory.…

Machine Learning · Statistics 2022-04-15 Yu Chen , Tom Diethe , Peter Flach

Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is particularly difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Angus Maiden , Bahareh Nakisa

We investigate the problem of incremental learning for object counting, where a method must learn to count a variety of object classes from a sequence of datasets. A na\"ive approach to incremental object counting would suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Chenshen Wu , Joost van de Weijer