English
Related papers

Related papers: Adaptive Online Incremental Learning for Evolving …

200 papers

Recently, images that distort or fabricate facts using generative models have become a social concern. To cope with continuous evolution of generative artificial intelligence (AI) models, model attribution (MA) is necessary beyond just…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hanbyul Lee , Juneho Yi

Catastrophic forgetting is a significant challenge in online continual learning (OCL), especially for non-stationary data streams that do not have well-defined task boundaries. This challenge is exacerbated by the memory constraints and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Xiwen Wei , Guihong Li , Radu Marculescu

A self-adaptive system can modify its own structure and behavior at runtime based on its perception of the environment, of itself and of its requirements. To develop a self-adaptive system, software developers codify knowledge about the…

Software Engineering · Computer Science 2022-10-13 Andreas Metzger , Clément Quinton , Zoltán Ádám Mann , Luciano Baresi , Klaus Pohl

The ever-growing speed at which data are generated nowadays, together with the substantial cost of labeling processes cause Machine Learning models to face scenarios in which data are partially labeled. The extreme case where such a…

Machine Learning · Computer Science 2024-07-09 Maria Arostegi , Miren Nekane Bilbao , Jesus L. Lobo , Javier Del Ser

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Although existing image anomaly detection methods yield impressive results, they are mostly an offline learning paradigm that requires excessive data pre-collection, limiting their adaptability in industrial scenarios with online streaming…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Han Gao , Huiyuan Luo , Fei Shen , Zhengtao Zhang

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its performance on previously-learned tasks drops dramatically. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Libo Huang , Yan Zeng , Chuanguang Yang , Zhulin An , Boyu Diao , Yongjun Xu

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

Machine Learning · Computer Science 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Domain incremental learning aims to adapt to a sequence of domains with access to only a small subset of data (i.e., memory) from previous domains. Various methods have been proposed for this problem, but it is still unclear how they are…

Machine Learning · Computer Science 2023-10-20 Haizhou Shi , Hao Wang

Object-centric learning (OCL) extracts the representation of objects with slots, offering an exceptional blend of flexibility and interpretability for abstracting low-level perceptual features. A widely adopted method within OCL is slot…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ke Fan , Zechen Bai , Tianjun Xiao , Tong He , Max Horn , Yanwei Fu , Francesco Locatello , Zheng Zhang

Online Continual Learning (OCL) models continuously adapt to nonstationary data streams, usually without task information. These settings are complex and many traditional CL methods fail, while online methods (mainly replay-based) suffer…

Machine Learning · Computer Science 2025-02-05 Edoardo Urettini , Antonio Carta

Given a stream of data sampled from non-stationary distributions, online continual learning (OCL) aims to adapt efficiently to new data while retaining existing knowledge. The typical approach to address information retention (the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zhipeng Cai , Vladlen Koltun , Ozan Sener

In this paper, we address the incremental classifier learning problem, which suffers from catastrophic forgetting. The main reason for catastrophic forgetting is that the past data are not available during learning. Typical approaches keep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Zhengyou Zhang , Yun Fu

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is…

Machine Learning · Computer Science 2024-03-14 Haowei Lin , Yijia Shao , Weinan Qian , Ningxin Pan , Yiduo Guo , Bing Liu

Continual reinforcement learning (CRL) refers to a naturalistic setting where an agent needs to endlessly evolve, by trial and error, to solve multiple tasks that are presented sequentially. One of the largest obstacles to CRL is that the…

Machine Learning · Computer Science 2025-07-15 Zichen Liu , Guoji Fu , Chao Du , Wee Sun Lee , Min Lin

Deep neural networks (DNNS) excel at learning from static datasets but struggle with continual learning, where data arrives sequentially. Catastrophic forgetting, the phenomenon of forgetting previously learned knowledge, is a primary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 S Balasubramanian , M Sai Subramaniam , Sai Sriram Talasu , Yedu Krishna P , Manepalli Pranav Phanindra Sai , Ravi Mukkamala , Darshan Gera

The performance of machine learning model can be further improved if contextual cues are provided as input along with base features that are directly related to an inference task. In offline learning, one can inspect historical training…

Machine Learning · Computer Science 2019-10-21 Kin Gwn Lore , Kishore K. Reddy

Continual learning requires the model to maintain the learned knowledge while learning from a non-i.i.d data stream continually. Due to the single-pass training setting, online continual learning is very challenging, but it is closer to the…

Machine Learning · Computer Science 2022-05-20 Gehui Shen , Shibo Jie , Ziheng Li , Zhi-Hong Deng