English
Related papers

Related papers: Automating concept-drift detection by self-evaluat…

200 papers

Detecting change-points in data is challenging because of the range of possible types of change and types of behaviour of data when there is no change. Statistically efficient methods for detecting a change will depend on both of these…

Machine Learning · Statistics 2024-08-29 Jie Li , Paul Fearnhead , Piotr Fryzlewicz , Tengyao Wang

Concept probing has recently garnered increasing interest as a way to help interpret artificial neural networks, dealing both with their typically large size and their subsymbolic nature, which ultimately renders them unfeasible for direct…

Artificial Intelligence · Computer Science 2025-07-25 Manuel de Sousa Ribeiro , Afonso Leote , João Leite

Trajectory prediction models often fail in real-world automated driving due to distributional shifts between training and test conditions. Such distributional shifts, whether behavioural or environmental, pose a critical risk by causing the…

Machine Learning · Computer Science 2026-04-15 Michele De Vita , Julian Wiederer , Vasileios Belagiannis

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer

Modern analytical systems must be ready to process streaming data and correctly respond to data distribution changes. The phenomenon of changes in data distributions is called concept drift, and it may harm the quality of the used models.…

Machine Learning · Computer Science 2021-10-26 Jędrzej Kozal , Filip Guzy , Michał Woźniak

Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design…

Machine Learning · Computer Science 2024-03-25 YiFan Zhang , Weiqi Chen , Zhaoyang Zhu , Dalin Qin , Liang Sun , Xue Wang , Qingsong Wen , Zhang Zhang , Liang Wang , Rong Jin

Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms.…

Machine Learning · Computer Science 2020-04-17 Gustavo A. Valencia-Zapata , Carolina Gonzalez-Canas , Michael G. Zentner , Okan Ersoy , Gerhard Klimeck

Automated machine learning techniques benefited from tremendous research progress in recently. These developments and the continuous-growing demand for machine learning experts led to the development of numerous AutoML tools. However, these…

Machine Learning · Computer Science 2021-06-15 Alexandru-Ionut Imbrea

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

Nowadays with a growing number of online controlling systems in the organization and also a high demand of monitoring and stats facilities that uses data streams to log and control their subsystems, data stream mining becomes more and more…

Machine Learning · Computer Science 2019-02-12 Radin Hamidi Rad , Maryam Amir Haeri

Data stream mining extracts information from large quantities of data flowing fast and continuously (data streams). They are usually affected by changes in the data distribution, giving rise to a phenomenon referred to as concept drift.…

Machine Learning · Computer Science 2020-09-22 Jesus L. Lobo , Javier Del Ser , Eneko Osaba , Albert Bifet , Francisco Herrera

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

Machine Learning · Computer Science 2024-03-11 Alessio Mazzetto

Despite the promising results of machine learning models in malicious files detection, they face the problem of concept drift due to their constant evolution. This leads to declining performance over time, as the data distribution of the…

Cryptography and Security · Computer Science 2024-08-02 William Maillet , Benjamin Marais

Time-series data is widely studied in various scenarios, like weather forecast, stock market, customer behavior analysis. To comprehensively learn about the dynamic environments, it is necessary to comprehend features from multiple data…

Human-Computer Interaction · Computer Science 2020-08-19 Xumeng Wang , Wei Chen , Jiazhi Xia , Zexian Chen , Dongshi Xu , Xiangyang Wu , Mingliang Xu , Tobias Schreck

Unlabeled streaming data are usually collected to describe dynamic systems, where concept drift detection is a vital prerequisite to understanding the evolution of systems. However, the drifting concepts are usually imbalanced in most real…

Machine Learning · Computer Science 2026-03-10 Yiqun Zhang , Zhanpei Huang , Mingjie Zhao , Chuyao Zhang , Yang Lu , Yuzhu Ji , Fangqing Gu , An Zeng

Training models continually to detect and classify objects, from new classes and new domains, remains an open problem. In this work, we conduct a thorough analysis of why and how object detection models forget catastrophically. We focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Eli Verwimp , Kuo Yang , Sarah Parisot , Hong Lanqing , Steven McDonagh , Eduardo Pérez-Pellitero , Matthias De Lange , Tinne Tuytelaars

Software aging is a phenomenon that affects long-running systems, leading to progressive performance degradation and increasing the risk of failures. To mitigate this problem, this work proposes an adaptive approach based on machine…

Software Engineering · Computer Science 2025-12-01 Rafael Jose Moura Silva , Maria Gizele Nascimento , Fumio Machida , Ermeson Andrade

Concept drift detectors allow learning systems to maintain good accuracy on non-stationary data streams. Financial time series are an instance of non-stationary data streams whose concept drifts (market phases) are so important to affect…

Statistical Finance · Quantitative Finance 2021-09-02 Filippo Neri

The label quality of defect data sets has a direct influence on the reliability of defect prediction models. In this study, for multi-version-project defect data sets, we propose an approach to automatically detecting instances with…

Software Engineering · Computer Science 2021-01-29 Shiran Liu , Zhaoqiang Guo , Yanhui Li , Chuanqi Wang , Lin Chen , Zhongbin Sun , Yuming Zhou