English
Related papers

Related papers: Continuous Evolution Pool: Taming Recurring Concep…

200 papers

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Concept drift and extreme verification latency pose significant challenges in data stream learning, particularly when dealing with recurring concept changes in dynamic environments. This work introduces a novel method based on the Growing…

Machine Learning · Computer Science 2025-04-11 Maria Arostegi , Miren Nekane Bilbao , Jesus L. Lobo , Javier Del Ser

Information networks are ubiquitous and are ideal for modeling relational data. Networks being sparse and irregular, network embedding algorithms have caught the attention of many researchers, who came up with numerous embeddings algorithms…

Machine Learning · Computer Science 2020-09-25 Junshan Wang , Yilun Jin , Guojie Song , Xiaojun Ma

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

Weather forecasting has seen a shift in methods from numerical simulations to data-driven systems. While initial research in the area focused on deterministic forecasting, recent works have used diffusion models to produce skillful ensemble…

Machine Learning · Computer Science 2025-04-15 Martin Andrae , Tomas Landelius , Joel Oskarsson , Fredrik Lindsten

Online anomaly detection from a data stream is critical for the safety and security of many applications but is facing severe challenges due to complex and evolving data streams from IoT devices and cloud-based infrastructures.…

Machine Learning · Computer Science 2022-06-13 Susik Yoon , Youngjun Lee , Jae-Gil Lee , Byung Suk Lee

Continual learning methods are known to suffer from catastrophic forgetting, a phenomenon that is particularly hard to counter for methods that do not store exemplars of previous tasks. Therefore, to reduce potential drift in the feature…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Dipam Goswami , Albin Soutif--Cormerais , Yuyang Liu , Sandesh Kamath , Bartłomiej Twardowski , Joost van de Weijer

Continual Learning (CL) aims at incrementally learning new tasks without forgetting the knowledge acquired from old ones. Experience Replay (ER) is a simple and effective rehearsal-based strategy, which optimizes the model with current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Zhuo , Zhiyong Cheng , Zan Gao , Hehe Fan , Mohan Kankanhalli

As world knowledge advances and new task schemas emerge, Continual Learning (CL) becomes essential for keeping Large Language Models (LLMs) current and addressing their shortcomings. This process typically involves continual instruction…

Machine Learning · Computer Science 2024-12-17 Haokun Zhao , Haixia Han , Jie Shi , Chengyu Du , Jiaqing Liang , Yanghua Xiao

Replay-based continual learning (CL) methods assume that models trained on a small subset can also effectively minimize the empirical risk of the complete dataset. These methods maintain a memory buffer that stores a sampled subset of data…

Machine Learning · Computer Science 2025-05-29 Wenyang Liao , Quanziang Wang , Yichen Wu , Renzhen Wang , Deyu Meng

In many clustering scenes, data samples' attribute values change over time. For such data, we are often interested in obtaining a partition for each time step and tracking the dynamic change of partitions. Normally, a smooth change is…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Qi Zhao , Bai Yan , Yuhui Shi

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

Models operating on dynamic physiologic signals must distinguish benign, label-preserving variability from true concept change. Existing concept-drift frameworks are largely distributional and provide no principled guidance on how much a…

Machine Learning · Computer Science 2026-03-02 Timothy Oladunni , Blessing Ojeme , Kyndal Maclin , Clyde Baidoo

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

Machine Learning · Computer Science 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

The remarkable success of large-scale contrastive pre-training has been largely driven by by vast yet static datasets. However, as the scaling paradigm evolves, this paradigm encounters a fundamental challenge when applied to dynamic data…

Machine Learning · Computer Science 2025-11-25 Xiaoyu Yang , Jie Lu , En Yu , Wei Duan

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

Machine learning (ML) algorithms deployed in real-world environments are often faced with the challenge of adapting models to concept drift, where the task data distributions are shifting over time. The problem becomes even more difficult…

Machine Learning · Computer Science 2026-01-19 Adam Piaseczny , Md Kamran Chowdhury Shisher , Shiqiang Wang , Christopher G. Brinton

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

Machine Learning · Computer Science 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

Machine Learning · Computer Science 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang