English
Related papers

Related papers: Representation Compensation Networks for Continual…

200 papers

Continual learning (CL) aims to incrementally learn different tasks (such as classification) in a non-stationary data stream without forgetting old ones. Most CL works focus on tackling catastrophic forgetting under a learning-from-scratch…

Machine Learning · Computer Science 2024-01-17 Mark D. McDonnell , Dong Gong , Amin Parveneh , Ehsan Abbasnejad , Anton van den Hengel

We introduce CellSegmenter, a structured deep generative model and an amortized inference framework for unsupervised representation learning and instance segmentation tasks. The proposed inference algorithm is convolutional and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Luca D'Alessio , Mehrtash Babadi

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, i.e. they perform…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Fabio Cermelli , Massimiliano Mancini , Samuel Rota Buló , Elisa Ricci , Barbara Caputo

Real-world natural language processing (NLP) models need to be continually updated to fix the prediction errors in out-of-distribution (OOD) data streams while overcoming catastrophic forgetting. However, existing continual learning (CL)…

Computation and Language · Computer Science 2022-05-05 Bill Yuchen Lin , Sida Wang , Xi Victoria Lin , Robin Jia , Lin Xiao , Xiang Ren , Wen-tau Yih

Recent efforts in multi-domain learning for semantic segmentation attempt to learn multiple geographical datasets in a universal, joint model. A simple fine-tuning experiment performed sequentially on three popular road scene segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Prachi Garg , Rohit Saluja , Vineeth N Balasubramanian , Chetan Arora , Anbumani Subramanian , C. V. Jawahar

Capturing global contextual representations by exploiting long-range pixel-pixel dependencies has shown to improve semantic segmentation performance. However, how to do this efficiently is an open question as current approaches of utilising…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Qinghui Liu , Michael Kampffmeyer , Robert Jenssen , Arnt-Børre Salberg

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Image segmentation based on continual learning exhibits a critical drop of performance, mainly due to catastrophic forgetting and background shift, as they are required to incorporate new classes continually. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Weijia Wu , Yuzhong Zhao , Zhuang Li , Lianlei Shan , Hong Zhou , Mike Zheng Shou

Textual information is considered as significant supplement to knowledge representation learning (KRL). There are two main challenges for constructing knowledge representations from plain texts: (1) How to take full advantages of sequential…

Computation and Language · Computer Science 2016-09-23 Jiawei Wu , Ruobing Xie , Zhiyuan Liu , Maosong Sun

Evolving data streams induce joint nonstationarity in continual semantic segmentation, where semantic classes, input distributions, and supervision availability change simultaneously over time. This setting reflects practical structured…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Prashant Pandey , Himanshu Kumar , Devineni Sri Venkatraya Chowdary , Brejesh Lall

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Lifelong learning, the problem of continual learning where tasks arrive in sequence, has been lately attracting more attention in the computer vision community. The aim of lifelong learning is to develop a system that can learn new tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-03-21 Jie Zhang , Junting Zhang , Shalini Ghosh , Dawei Li , Jingwen Zhu , Heming Zhang , Yalin Wang

This work addresses the task of open world semantic segmentation using RGBD sensing to discover new semantic classes over time. Although there are many types of objects in the real-word, current semantic segmentation methods make a closed…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Yoshikatsu Nakajima , Byeongkeun Kang , Hideo Saito , Kris Kitani

Latent representation learned from multi-layered neural networks via hierarchical feature abstraction enables recent success of deep learning. Under the deep learning framework, generalization performance highly depends on the learned…

Machine Learning · Computer Science 2016-11-07 Hyo-Eun Kim , Sangheum Hwang , Kyunghyun Cho

Humans learn adaptively and efficiently throughout their lives. However, incrementally learning tasks causes artificial neural networks to overwrite relevant information learned about older tasks, resulting in 'Catastrophic Forgetting'.…

Machine Learning · Computer Science 2021-02-04 Gobinda Saha , Isha Garg , Aayush Ankit , Kaushik Roy

Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. To this end, it is crucial to learn novel classes incrementally without forgetting previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Donghyeon Baek , Youngmin Oh , Sanghoon Lee , Junghyup Lee , Bumsub Ham

Accurate retinal vessel segmentation is an important task for many computer-aided diagnosis systems. Yet, it is still a challenging problem due to the complex vessel structures of an eye. Numerous vessel segmentation methods have been…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Ali Karaali , Rozenn Dahyot , Donal J. Sexton

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. We opt for top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Fenggen Yu , Kun Liu , Yan Zhang , Chenyang Zhu , Kai Xu

Modeling crisp logical regularities is crucial in semantic parsing, making it difficult for neural models with no task-specific prior knowledge to achieve good results. In this paper, we introduce data recombination, a novel framework for…

Computation and Language · Computer Science 2016-06-14 Robin Jia , Percy Liang