English
Related papers

Related papers: OLC-WA: Drift Aware Tuning-Free Online Classificat…

200 papers

While test-time scaling has enabled large language models to solve highly difficult tasks, state-of-the-art results come at exorbitant compute costs. These inefficiencies can be attributed to the miscalibration of post-trained language…

Machine Learning · Computer Science 2026-04-02 Cai Zhou , Zekai Wang , Menghua Wu , Qianyu Julie Zhu , Flora C. Shi , Chenyu Wang , Ashia Wilson , Tommi Jaakkola , Stephen Bates

Data streams in real-world industrial scenarios often contain transitional operating conditions that are uncovered during offline training, leading to significant distribution shifts. To bridge the gap between static offline models and…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Hongshuo Zhao , Zeyi Liu , Xiao He

Screening feature selection methods are often used as a preprocessing step for reducing the number of variables before training step. Traditional screening methods only focus on dealing with complete high dimensional datasets. Modern…

Machine Learning · Statistics 2021-04-08 Mingyuan Wang , Adrian Barbu

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

Traditional machine learning assumes a stationary data distribution, yet many real-world applications operate on nonstationary streams in which the underlying concept evolves over time. This problem can also be viewed as task-free continual…

Machine Learning · Computer Science 2026-03-17 Michal Wozniak , Marek Klonowski , Maciej Maczynski , Bartosz Krawczyk

The change in data distribution over time, also known as concept drift, poses a significant challenge to the reliability of online learning methods. Existing methods typically require model retraining or drift detection, both of which…

Machine Learning · Computer Science 2025-06-11 Songqiao Hu , Zeyi Liu , Xiao He

Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design…

Machine Learning · Computer Science 2024-03-25 YiFan Zhang , Weiqi Chen , Zhaoyang Zhu , Dalin Qin , Liang Sun , Xue Wang , Qingsong Wen , Zhang Zhang , Liang Wang , Rong Jin

When learning from streaming data, a change in the data distribution, also known as concept drift, can render a previously-learned model inaccurate and require training a new model. We present an adaptive learning algorithm that extends…

Machine Learning · Computer Science 2020-08-04 Ashraf Tahmasbi , Ellango Jothimurugesan , Srikanta Tirthapura , Phillip B. Gibbons

Click-through rate (CTR) prediction is a crucial task in web search, recommender systems, and online advertisement displaying. In practical application, CTR models often serve with high-speed user-generated data streams, whose underlying…

Information Retrieval · Computer Science 2023-02-24 Congcong Liu , Yuejiang Li , Fei Teng , Xiwei Zhao , Changping Peng , Zhangang Lin , Jinghe Hu , Jingping Shao

Real-time forecasting from streaming data poses critical challenges: handling non-stationary dynamics, operating under strict computational limits, and adapting rapidly without catastrophic forgetting. However, many existing approaches face…

Machine Learning · Computer Science 2025-10-20 Christopher Salazar , Krithika Manohar , Ashis G. Banerjee

Transfer learning has achieved promising results by leveraging knowledge from the source domain to annotate the target domain which has few or none labels. Existing methods often seek to minimize the distribution divergence between domains,…

Machine Learning · Computer Science 2018-07-03 Jindong Wang , Yiqiang Chen , Shuji Hao , Wenjie Feng , Zhiqi Shen

In autonomous driving, even a meticulously trained model can encounter failures when facing unfamiliar scenarios. One of these scenarios can be formulated as an online continual learning (OCL) problem. That is, data come in an online…

Machine Learning · Computer Science 2024-11-06 Huiping Zhuang , Di Fang , Kai Tong , Yuchen Liu , Ziqian Zeng , Xu Zhou , Cen Chen

The standard supervised learning paradigm works effectively when training data shares the same distribution as the upcoming testing samples. However, this stationary assumption is often violated in real-world applications, especially when…

Machine Learning · Computer Science 2023-01-18 Yong Bai , Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama , Zhi-Hua Zhou

This paper focuses on supervised and unsupervised online label shift, where the class marginals $Q(y)$ varies but the class-conditionals $Q(x|y)$ remain invariant. In the unsupervised setting, our goal is to adapt a learner, trained on some…

In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance…

Machine Learning · Computer Science 2024-11-26 Vennela Yarabolu , Govind Waghmare , Sonia Gupta , Siddhartha Asthana

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

The moving average (MA)-type scheme, also known as the smoothing method, has been well established within the multivariate statistical process monitoring (MSPM) framework since the 1990s. However, its theoretical basis is still limited to…

Information Theory · Computer Science 2020-11-11 Yinghong Zhao , Xiao He , Junfeng Zhang , Hongquan Ji , Donghua Zhou , Michael G. Pecht

Effective object detection in autonomous vehicles is challenged by deployment in diverse and unfamiliar environments. Online Source-Free Domain Adaptation (O-SFDA) offers model adaptation using a stream of unlabeled data from a target…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiangyu Shi , Yanyuan Qiao , Qi Wu , Lingqiao Liu , Feras Dayoub

Concept drift refers to a change in the data distribution affecting the data stream of future samples. Consequently, learning models operating on the data stream might become obsolete, and need costly and difficult adjustments such as…

Machine Learning · Computer Science 2023-09-20 André Artelt , Kleanthis Malialis , Christos Panayiotou , Marios Polycarpou , Barbara Hammer

We study online conformal prediction for non-stationary data streams subject to unknown distribution drift. While most prior work studied this problem under adversarial settings and/or assessed performance in terms of gaps of time-averaged…

Statistics Theory · Mathematics 2026-03-06 Jiadong Liang , Zhimei Ren , Yuxin Chen