中文
相关论文

相关论文: Contrastive Continual Learning with Importance Sam…

200 篇论文

Class incremental semantic segmentation (CISS) aims to segment new classes during continual steps while preventing the forgetting of old knowledge. Existing methods alleviate catastrophic forgetting by replaying distributions of previously…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Guilin Zhu , Dongyue Wu , Changxin Gao , Runmin Wang , Weidong Yang , Nong Sang

Continual video instance segmentation demands both the plasticity to absorb new object categories and the stability to retain previously learned ones, all while preserving temporal consistency across frames. In this work, we introduce…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Baichen Liu , Qi Lyu , Xudong Wang , Jiahua Dong , Lianqing Liu , Zhi Han

In many real-world scenarios, data to train machine learning models become available over time. However, neural network models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon…

机器学习 · 计算机科学 2022-06-29 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

We argue that the negative transfer problem occurring when the new task to learn arrives is an important problem that needs not be overlooked when developing effective Continual Reinforcement Learning (CRL) algorithms. Through comprehensive…

机器学习 · 计算机科学 2025-11-05 Hongjoon Ahn , Jinu Hyeon , Youngmin Oh , Bosun Hwang , Taesup Moon

Neural networks notoriously suffer from the problem of catastrophic forgetting, the phenomenon of forgetting the past knowledge when acquiring new knowledge. Overcoming catastrophic forgetting is of significant importance to emulate the…

机器学习 · 计算机科学 2021-04-20 Christian Simon , Piotr Koniusz , Mehrtash Harandi

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haojin Deng , Yimin Yang

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

计算机视觉与模式识别 · 计算机科学 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

We study the discriminative probabilistic modeling on a continuous domain for the data prediction task of (multimodal) self-supervised representation learning. To address the challenge of computing the integral in the partition function for…

机器学习 · 计算机科学 2025-03-06 Bokun Wang , Yunwen Lei , Yiming Ying , Tianbao Yang

Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong…

计算机视觉与模式识别 · 计算机科学 2020-09-03 Wang Zhou , Shiyu Chang , Norma Sosa , Hendrik Hamann , David Cox

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

机器学习 · 计算机科学 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Continual learning algorithms aim to learn from a sequence of tasks. In order to avoid catastrophic forgetting, most existing approaches rely on heuristics and do not provide computable learning guarantees. In this paper, we introduce…

机器学习 · 计算机科学 2026-02-27 Jacob Comeau , Mathieu Bazinet , Pascal Germain , Cem Subakan

Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. To this end, it is crucial to learn novel classes incrementally without forgetting previously learned…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Donghyeon Baek , Youngmin Oh , Sanghoon Lee , Junghyup Lee , Bumsub Ham

Continual learning -- the ability to acquire knowledge incrementally without forgetting previous skills -- is fundamental to natural intelligence. While the human brain excels at this, artificial neural networks struggle with "catastrophic…

机器学习 · 计算机科学 2025-09-16 Aoi Otani

The main challenge of continual learning is \textit{catastrophic forgetting}. Because of processing data in one pass, online continual learning (OCL) is one of the most difficult continual learning scenarios. To address catastrophic…

机器学习 · 计算机科学 2025-10-02 Aopeng Wang , Ke Deng , Yongli Ren , Jun Luo

Continual learning techniques employ simple replay sample selection processes and use them during subsequent tasks. Typically, they rely on labeled data. In this paper, we depart from this by automatically selecting prototypes stored…

机器学习 · 计算机科学 2025-04-11 Agil Aghasanli , Yi Li , Plamen Angelov

Replay-based continual learning (CL) methods assume that models trained on a small subset can also effectively minimize the empirical risk of the complete dataset. These methods maintain a memory buffer that stores a sampled subset of data…

机器学习 · 计算机科学 2025-05-29 Wenyang Liao , Quanziang Wang , Yichen Wu , Renzhen Wang , Deyu Meng

Continual Learning (CL) aims to learn new data while remembering previously acquired knowledge. In contrast to CL for image classification, CL for Object Detection faces additional challenges such as the missing annotations problem. In this…

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

机器学习 · 计算机科学 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang