English
Related papers

Related papers: Online Boosting Adaptive Learning under Concept Dr…

200 papers

An enormous and ever-growing volume of data is nowadays becoming available in a sequential fashion in various real-world applications. Learning in nonstationary environments constitutes a major challenge, and this problem becomes orders of…

Machine Learning · Computer Science 2020-09-28 Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal…

Statistics Theory · Mathematics 2021-08-20 Ruijian Han , Lan Luo , Yuanyuan Lin , Jian Huang

We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown…

Machine Learning · Computer Science 2021-10-28 Guanya Shi , Kamyar Azizzadenesheli , Michael O'Connell , Soon-Jo Chung , Yisong Yue

The last decade has seen a surge of interest in adaptive learning algorithms for data stream classification, with applications ranging from predicting ozone level peaks, learning stock market indicators, to detecting computer security…

Machine Learning · Statistics 2018-08-13 Ali Pesaranghader , Herna Viktor , Eric Paquet

Nowadays, every device connected to the Internet generates an ever-growing stream of data (formally, unbounded). Machine Learning on unbounded data streams is a grand challenge due to its resource constraints. In fact, standard machine…

Machine Learning · Computer Science 2019-11-19 Alessio Bernardo , Emanuele Della Valle , Albert Bifet

Learning from multiple data streams in real-world scenarios is fundamentally challenging due to intrinsic heterogeneity and unpredictable concept drifts. Existing methods typically assume homogeneous streams and employ static architectures…

Machine Learning · Computer Science 2025-08-05 En Yu , Jie Lu , Kun Wang , Xiaoyu Yang , Guangquan Zhang

In big data era, the data continuously generated and its distribution may keep changes overtime. These challenges in online stream of data are known as concept drift. In this paper, we proposed the Adaptive Convolutional ELM method…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Knowledge transfer across several streaming processes remain challenging problem not only because of different distributions of each stream but also because of rapidly changing and never-ending environments of data streams. Albeit growing…

Machine Learning · Computer Science 2021-09-14 Renchunzi Xie , Mahardhika Pratama

Real-world data sets often exhibit temporal dynamics characterized by evolving data distributions. Disregarding this phenomenon, commonly referred to as concept drift, can significantly diminish a model's predictive accuracy. Furthermore,…

Machine Learning · Computer Science 2025-12-16 Mohammad Abu Shaira , Yunhe Feng , Heng Fan , Weishi Shi

Online learning, where feature spaces can change over time, offers a flexible learning paradigm that has attracted considerable attention. However, it still faces three significant challenges. First, the heterogeneity of real-world data…

Machine Learning · Computer Science 2025-07-17 Shengda Zhuo , Di Wu , Yi He , Shuqiang Huang , Xindong Wu

One of the significant problems of streaming data classification is the occurrence of concept drift, consisting of the change of probabilistic characteristics of the classification task. This phenomenon destabilizes the performance of the…

Machine Learning · Computer Science 2021-12-21 Michał Woźniak , Paweł Zyblewski , Paweł Ksieniewicz

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

Machine Learning · Computer Science 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

In recent years, with the increasing popularity of "Smart Technology", the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT…

Machine Learning · Computer Science 2021-05-27 Li Yang , Abdallah Shami

In Online Continual Learning (OCL), a neural network sequentially learns from a non-stationary data stream in a single-pass with access only to a limited memory replay buffer. This contrasts sharply with off-line continual learning where…

Machine Learning · Computer Science 2026-05-20 Ankita Awasthi , Marco Apolinario , Kaushik Roy

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

Machine Learning · Computer Science 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

We revisit the common practice of evaluating adaptation of Online Continual Learning (OCL) algorithms through the metric of online accuracy, which measures the accuracy of the model on the immediate next few samples. However, we show that…

Machine Learning · Computer Science 2023-05-17 Hasan Abed Al Kader Hammoud , Ameya Prabhu , Ser-Nam Lim , Philip H. S. Torr , Adel Bibi , Bernard Ghanem

In this paper, we propose an AdaBoost-assisted extreme learning machine for efficient online sequential classification (AOS-ELM). In order to achieve better accuracy in online sequential learning scenarios, we utilize the cost-sensitive…

Machine Learning · Computer Science 2019-09-17 Yi-Ta Chen , Yu-Chuan Chuang , An-Yeu , Wu

We present a novel adaptive online learning (AOL) framework to predict human movement trajectories in dynamic video scenes. Our framework learns and adapts to changes in the scene environment and generates best network weights for different…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Manh Huynh , Gita Alaghband