English
Related papers

Related papers: Drift-aware Collaborative Assistance Mixture of Ex…

200 papers

Domain incremental learning (DIL) poses a significant challenge in real-world scenarios, as models need to be sequentially trained on diverse domains over time, all the while avoiding catastrophic forgetting. Mitigating representation…

Machine Learning · Computer Science 2024-06-25 Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Deep neural networks have been shown as a class of useful tools for addressing signal recognition issues in recent years, especially for identifying the nonlinear feature structures of signals. However, this power of most deep learning…

Machine Learning · Computer Science 2021-06-15 Yihong Dong , Ying Peng , Muqiao Yang , Songtao Lu , Qingjiang Shi

Recent years have witnessed enormous progress of online learning. However, a major challenge on the road to artificial agents is concept drift, that is, the data probability distribution would change where the data instance arrives…

Machine Learning · Computer Science 2022-01-26 Ya-nan Han , Jian-wei Liu , Bing-biao Xiao , Xin-Tan Wang , Xiong-lin Luo

Learning from non-stationary data streams subject to concept drift requires models that can adapt on-the-fly while remaining resource-efficient. Existing adaptive ensemble methods often rely on coarse-grained adaptation mechanisms or simple…

When learning from streaming data, a change in the data distribution, also known as concept drift, can render a previously-learned model inaccurate and require training a new model. We present an adaptive learning algorithm that extends…

Machine Learning · Computer Science 2020-08-04 Ashraf Tahmasbi , Ellango Jothimurugesan , Srikanta Tirthapura , Phillip B. Gibbons

Besides independent learning, human learning process is highly improved by summarizing what has been learned, communicating it with peers, and subsequently fusing knowledge from different sources to assist the current learning goal. This…

Machine Learning · Computer Science 2017-02-21 Kaixiang Lin , Shu Wang , Jiayu Zhou

Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on…

Machine Learning · Computer Science 2021-09-02 Yujing Chen , Zheng Chai , Yue Cheng , Huzefa Rangwala

Hybrid parallelism techniques are essential for efficiently training large language models (LLMs). Nevertheless, current automatic parallel planning frameworks often overlook the simultaneous consideration of node heterogeneity and dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-04 Ruilong Wu , Xinjiao Li , Yisu Wang , Xinyu Chen , Dirk Kutscher

Online multi-object tracking has been recently dominated by tracking-by-detection (TbD) methods, where recent advances rely on increasingly sophisticated heuristics for tracklet representation, feature fusion, and multi-stage matching. The…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Vladimir Somers , Baptiste Standaert , Victor Joos , Alexandre Alahi , Christophe De Vleeschouwer

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Human perception generalizes well across different domains, but most vision models struggle beyond their training data. This gap motivates multi-dataset learning, where a single model is trained on diverse datasets to improve robustness…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Pourya Shamsolmoali , Masoumeh Zareapoor , Huiyu Zhou , Oscar Mendez , Dacheng Tao , Xuelong Li

AI inference at the edge is becoming increasingly common for low-latency services. However, edge environments are power- and resource-constrained, and susceptible to failures. Conventional failure resilience approaches, such as cloud…

Multistream classification poses significant challenges due to the necessity for rapid adaptation in dynamic streaming processes with concept drift. Despite the growing research outcomes in this area, there has been a notable oversight…

Machine Learning · Computer Science 2024-01-02 En Yu , Jie Lu , Bin Zhang , Guangquan Zhang

In real-world applications, the process generating the data might suffer from nonstationary effects (e.g., due to seasonality, faults affecting sensors or actuators, and changes in the users' behaviour). These changes, often called concept…

Machine Learning · Computer Science 2025-08-25 Kleanthis Malialis , Manuel Roveri , Cesare Alippi , Christos G. Panayiotou , Marios M. Polycarpou

Concept drift and extreme verification latency pose significant challenges in data stream learning, particularly when dealing with recurring concept changes in dynamic environments. This work introduces a novel method based on the Growing…

Machine Learning · Computer Science 2025-04-11 Maria Arostegi , Miren Nekane Bilbao , Jesus L. Lobo , Javier Del Ser

Text-based person retrieval aims to identify specific individuals within an image database using textual descriptions. Due to the high cost of annotation and privacy protection, researchers resort to synthesized data for the paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hang Yu , Jiahao Wen , Zhedong Zheng

Continuous machine learning pipelines are common in industrial settings where models are periodically trained on data streams. Unfortunately, concept drifts may occur in data streams where the joint distribution of the data X and label y,…

Machine Learning · Computer Science 2023-12-18 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang

Multi-agent learning faces a fundamental tension: leveraging distributed collaboration without sacrificing the personalization needed for diverse agents. This tension intensifies when aiming for full personalization while adapting to…

Machine Learning · Statistics 2026-03-11 Chenyu Zhang , Navid Azizan

Multi-Domain Continual Learning (MDCL) acquires knowledge from sequential tasks with shifting class sets and distribution. Despite the Parameter-Efficient Fine-Tuning (PEFT) methods can adapt for this dual heterogeneity, they still suffer…

Machine Learning · Computer Science 2025-08-12 Jialu Zhou , Dianxi Shi , Shaowu Yang , Xinyu Wei , Mingyue Yang , Leqian Li , Mengzhu Wang , Chunping Qiu