中文
相关论文

相关论文: Enhancing Online Continual Learning with Plug-and-…

200 篇论文

A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of models to rapidly learn new information in real-world scenarios where data follows long-tailed distributions, all while avoiding forgetting…

机器学习 · 计算机科学 2024-04-09 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

机器学习 · 计算机科学 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

We focus on a relatively unexplored learning paradigm known as {\em Online Unsupervised Continual Learning} (O-UCL), where an agent receives a non-stationary, unlabeled data stream and progressively learns to identify an increasing number…

机器学习 · 计算机科学 2024-09-26 Cameron Taylor , Vassilis Vassiliades , Constantine Dovrolis

Recent years have witnessed growing interests in online incremental learning. However, there are three major challenges in this area. The first major difficulty is concept drift, that is, the probability distribution in the streaming data…

机器学习 · 计算机科学 2022-01-06 Si-si Zhang , Jian-wei Liu , Xin Zuo

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

机器学习 · 计算机科学 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

机器学习 · 计算机科学 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Object-centric learning (OCL) aims to learn representations of individual objects within visual scenes without manual supervision, facilitating efficient and effective visual reasoning. Traditional OCL methods primarily employ bottom-up…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Dongwon Kim , Seoyeon Kim , Suha Kwak

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

机器学习 · 计算机科学 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

机器学习 · 计算机科学 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

机器学习 · 计算机科学 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

Continual learning (CL) is a technique that enables neural networks to constantly adapt to their dynamic surroundings. Despite being overlooked for a long time, this technology can considerably address the customized needs of users in edge…

机器学习 · 计算机科学 2025-03-11 Zeqing Wang , Fei Cheng , Kangye Ji , Bohu Huang

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

机器学习 · 计算机科学 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye

In Online Continual Learning (OCL) a learning system receives a stream of data and sequentially performs prediction and training steps. Important challenges in OCL are concerned with automatic adaptation to the particular non-stationary…

Continual learning (CL) refers to the ability of an algorithm to continuously and incrementally acquire new knowledge from its environment while retaining previously learned information. A model trained on one data modality often fails when…

机器学习 · 计算机科学 2025-08-22 Nilay Kushawaha , Egidio Falotico

In real-world environments, continual learning is essential for machine learning models, as they need to acquire new knowledge incrementally without forgetting what they have already learned. While pretrained language models have shown…

机器学习 · 计算机科学 2024-06-28 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

Continual Learning (CL) and Streaming Machine Learning (SML) study the ability of agents to learn from a stream of non-stationary data. Despite sharing some similarities, they address different and complementary challenges. While SML…

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

机器学习 · 计算机科学 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

We propose a novel framework DropTop that suppresses the shortcut bias in online continual learning (OCL) while being adaptive to the varying degree of the shortcut bias incurred by continuously changing environment. By the observed…

机器学习 · 计算机科学 2023-12-15 Doyoung Kim , Dongmin Park , Yooju Shin , Jihwan Bang , Hwanjun Song , Jae-Gil Lee

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

机器学习 · 计算机科学 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

Online continual learning aims to get closer to a live learning experience by learning directly on a stream of data with temporally shifting distribution and by storing a minimum amount of data from that stream. In this empirical…