中文
相关论文

相关论文: A Plasticity-Aware Method for Continual Self-Super…

200 篇论文

Continuous pseudo-labeling (PL) algorithms such as slimIPL have recently emerged as a powerful strategy for semi-supervised learning in speech recognition. In contrast with earlier strategies that alternated between training a model and…

机器学习 · 计算机科学 2023-02-01 Tatiana Likhomanenko , Ronan Collobert , Navdeep Jaitly , Samy Bengio

Remote sensing (RS) involves the acquisition of data about objects or areas from a distance, primarily to monitor environmental changes, manage resources, and support planning and disaster response. A significant challenge in RS…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Hui Ye , Haodong Chen , Xiaoming Chen , Vera Chung

An intelligent Real-Time Sensing (RTS) system must continuously acquire, update, integrate, and apply knowledge to adapt to real-world dynamics. Managing distributed intelligence in this context requires Federated Continual Learning (FCL).…

We focus on domain and class generalization problems in analyzing optical remote sensing images, using the large-scale pre-trained vision-language model (VLM), CLIP. While contrastively trained VLMs show impressive zero-shot generalization…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Avigyan Bhattacharya , Mainak Singha , Ankit Jha , Biplab Banerjee

Continual learning has been a major problem in the deep learning community, where the main challenge is how to effectively learn a series of newly arriving tasks without forgetting the knowledge of previous tasks. Initiated by Learning…

机器学习 · 计算机科学 2021-07-06 Jong-Yeong Kim , Dong-Wan Choi

Most continual learning (CL) algorithms have focused on tackling the stability-plasticity dilemma, that is, the challenge of preventing the forgetting of previous tasks while learning new ones. However, they have overlooked the impact of…

机器学习 · 计算机科学 2023-03-22 Donggyu Lee , Sangwon Jung , Taesup Moon

This paper introduces a solid state-of-the-art baseline for a class-incremental semantic segmentation (CISS) problem. While the recent CISS algorithms utilize variants of the knowledge distillation (KD) technique to tackle the problem, they…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Sungmin Cha , Beomyoung Kim , Youngjoon Yoo , Taesup Moon

Deep learning approaches are nowadays ubiquitously used to tackle computer vision tasks such as semantic segmentation, requiring large datasets and substantial computational power. Continual learning for semantic segmentation (CSS) is an…

计算机视觉与模式识别 · 计算机科学 2021-03-12 Arthur Douillard , Yifu Chen , Arnaud Dapogny , Matthieu Cord

Continual offline reinforcement learning (CORL) aims to learn a sequence of tasks from datasets collected over time while preserving performance on previously learned tasks. This setting corresponds to domains where new tasks arise over…

机器学习 · 计算机科学 2026-04-29 Dominik Żurek , Kamil Faber , Marcin Pietron , Paweł Gajewski , Roberto Corizzo

Self-supervised learning has gained significant attention in contemporary applications, particularly due to the scarcity of labeled data. While existing SSL methodologies primarily address feature variance and linear correlations, they…

机器学习 · 计算机科学 2025-11-18 M. Hadi Sepanj , Benyamin Ghojogh , Paul Fieguth

Continual learning remains challenging due to catastrophic forgetting, where neural networks lose previously acquired knowledge when learning new tasks. Inspired by memory consolidation in neuroscience, we propose FSC-Net (Fast-Slow…

机器学习 · 计算机科学 2025-11-18 Mohamed El Gorrim

Rehearsal-based approaches are a mainstay of continual learning (CL). They mitigate the catastrophic forgetting problem by maintaining a small fixed-size buffer with a subset of data from past tasks. While most rehearsal-based approaches…

机器学习 · 计算机科学 2023-05-02 Zifeng Wang , Zheng Zhan , Yifan Gong , Yucai Shao , Stratis Ioannidis , Yanzhi Wang , Jennifer Dy

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

机器学习 · 计算机科学 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

机器学习 · 计算机科学 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Continual learning aims to learn multiple tasks sequentially while preserving prior knowledge, but faces the challenge of catastrophic forgetting when adapting to new tasks. Recently, approaches leveraging pre-trained models have gained…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Quan Cheng , Yuanyu Wan , Lingyu Wu , Chenping Hou , Lijun Zhang

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

计算与语言 · 计算机科学 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko

Contemporary transfer learning-based methods to alleviate the data insufficiency in change detection (CD) are mainly based on ImageNet pre-training. Self-supervised learning (SSL) has recently been introduced to remote sensing (RS) for…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Hao Chen , Yifan Zao , Liqin Liu , Song Chen , Zhenwei Shi

We propose a novel regularization-based continual learning method, dubbed as Adaptive Group Sparsity based Continual Learning (AGS-CL), using two group sparsity-based penalties. Our method selectively employs the two penalties when learning…

机器学习 · 计算机科学 2021-06-01 Sangwon Jung , Hongjoon Ahn , Sungmin Cha , Taesup Moon

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

机器学习 · 计算机科学 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Humans and animals learn throughout their lives from limited amounts of sensed data, both with and without supervision. Autonomous, intelligent robots of the future are often expected to do the same. The existing continual learning (CL)…

机器学习 · 计算机科学 2024-04-02 Elvin Hajizada , Balachandran Swaminathan , Yulia Sandamirskaya