English
Related papers

Related papers: Adaptive Online Incremental Learning for Evolving …

200 papers

We present a novel adaptive online learning (AOL) framework to predict human movement trajectories in dynamic video scenes. Our framework learns and adapts to changes in the scene environment and generates best network weights for different…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Manh Huynh , Gita Alaghband

Online learning, where feature spaces can change over time, offers a flexible learning paradigm that has attracted considerable attention. However, it still faces three significant challenges. First, the heterogeneity of real-world data…

Machine Learning · Computer Science 2025-07-17 Shengda Zhuo , Di Wu , Yi He , Shuqiang Huang , Xindong Wu

Lifelong learning in artificial intelligence (AI) aims to mimic the biological brain's ability to continuously learn and retain knowledge, yet it faces challenges such as catastrophic forgetting. Recent neuroscience research suggests that…

Artificial Intelligence · Computer Science 2024-09-24 Jin Du , Xinhe Zhang , Hao Shen , Xun Xian , Ganghua Wang , Jiawei Zhang , Yuhong Yang , Na Li , Jia Liu , Jie Ding

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most existing object…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xialei Liu , Hao Yang , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Incremental learning requires a model to continually learn new tasks from streaming data. However, traditional fine-tuning of a well-trained deep neural network on a new task will dramatically degrade performance on the old task -- a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Can Peng , Kun Zhao , Sam Maksoud , Meng Li , Brian C. Lovell

We introduce and study the problem of Online Continual Compression, where one attempts to simultaneously learn to compress and store a representative dataset from a non i.i.d data stream, while only observing each sample once. A naive…

Machine Learning · Computer Science 2020-08-24 Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Joelle Pineau

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

Machine Learning · Computer Science 2020-08-31 Yiren Lu , Jonathan Tompson

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai

Continual learning (CL) empowers AI systems to progressively acquire knowledge from non-stationary data streams. However, catastrophic forgetting remains a critical challenge. In this work, we identify attention drift in Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yue Lu , Xiangyu Zhou , Shizhou Zhang , Yinghui Xing , Guoqiang Liang , Wencong Zhang

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Existing open set recognition (OSR) methods are typically designed for static scenarios, where models aim to classify known classes and identify unknown ones within fixed scopes. This deviates from the expectation that the model should…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Runqing Yang , Yimin Fu , Changyuan Wu , Zhunga Liu

In our ever-evolving world, new data exhibits a long-tailed distribution, such as e-commerce platform reviews. This necessitates continuous model learning imbalanced data without forgetting, addressing the challenge of long-tailed…

Machine Learning · Computer Science 2024-09-12 Zhi-Hong Qi , Da-Wei Zhou , Yiran Yao , Han-Jia Ye , De-Chuan Zhan

Online continual learning (OCL) seeks to learn new tasks from data streams that appear only once, while retaining knowledge of previously learned tasks. Most existing methods rely on replay, focusing on enhancing memory retention through…

Machine Learning · Computer Science 2024-12-25 Sihao Liu , Yibo Yang , Xiaojie Li , David A. Clifton , Bernard Ghanem

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

Machine Learning · Computer Science 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

Optimization and Control · Mathematics 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

Machine Learning · Computer Science 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

Catastrophic forgetting is one of the main obstacles for Online Continual Graph Learning (OCGL), where nodes arrive one by one, distribution drifts may occur at any time and offline training on task-specific subgraphs is not feasible. In…

Machine Learning · Computer Science 2025-10-09 Giovanni Donghi , Daniele Zambon , Luca Pasa , Cesare Alippi , Nicolò Navarin

Catastrophic forgetting makes neural network models unstable when learning visual domains consecutively. The neural network model drifts to catastrophic forgetting-induced low performance of previously learnt domains when training with new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sayan Rakshit , Hmrishav Bandyopadhyay , Nibaran Das , Biplab Banerjee

Click-through rate (CTR) prediction is of great importance in recommendation systems and online advertising platforms. When served in industrial scenarios, the user-generated data observed by the CTR model typically arrives as a stream.…

Information Retrieval · Computer Science 2023-04-19 Congcong Liu , Fei Teng , Xiwei Zhao , Zhangang Lin , Jinghe Hu , Jingping Shao