English
Related papers

Related papers: Automating concept-drift detection by self-evaluat…

200 papers

Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Dror Simon , Miriam Farber , Roman Goldenberg

In current AI era, users may request AI companies to delete their data from the training dataset due to the privacy concerns. As a model owner, retraining a model will consume significant computational resources. Therefore, machine…

Machine Learning · Computer Science 2024-05-27 Wenhan Chang , Tianqing Zhu , Heng Xu , Wenjian Liu , Wanlei Zhou

The ability to detect when a system undergoes an incipient fault is of paramount importance in preventing a critical failure. Classic methods for fault detection (including model-based and data-driven approaches) rely on thresholding error…

Signal Processing · Electrical Eng. & Systems 2025-02-13 Camilo Ramírez , Jorge F. Silva , Ferhat Tamssaouet , Tomás Rojas , Marcos E. Orchard

Automatic Machine Learning (Auto-ML) has attracted more and more attention in recent years, our work is to solve the problem of data drift, which means that the distribution of data will gradually change with the acquisition process,…

Machine Learning · Computer Science 2019-08-30 Jinlong Chai , Jiangeng Chang , Yakun Zhao , Honggang Liu

Concept shift occurs when the distribution of labels conditioned on the features changes between domains, which can make even a well-tuned ML model miscalibrated on a new domain. Identifying these shifted features provides unique insight…

Machine Learning · Computer Science 2026-05-29 Ruiqi Lyu , Alistair Turcan , Bryan Wilder

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Topic models jointly learn topics and document-level topic distribution. Extrinsic evaluation of topic models tends to focus exclusively on topic-level evaluation, e.g. by assessing the coherence of topics. We demonstrate that there can be…

Computation and Language · Computer Science 2017-06-19 Shraey Bhatia , Jey Han Lau , Timothy Baldwin

Malware classification in dynamic environments presents a significant challenge due to concept drift, where the statistical properties of malware data evolve over time, complicating detection efforts. To address this issue, we propose a…

Machine Learning · Computer Science 2025-03-11 Bishwajit Prasad Gond , Durga Prasad Mohapatra

A method of finding and classifying various components and objects in a design diagram, drawing, or planning layout is proposed. The method automatically finds the objects present in a legend table and finds their position, count and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Sourish Sarkar , Pranav Pandey , Sibsambhu Kar

We study online conformal prediction for non-stationary data streams subject to unknown distribution drift. While most prior work studied this problem under adversarial settings and/or assessed performance in terms of gaps of time-averaged…

Statistics Theory · Mathematics 2026-03-06 Jiadong Liang , Zhimei Ren , Yuxin Chen

In user targeting automation systems, concept drift in input data is one of the main challenges. It deteriorates model performance on new data over time. Previous research on concept drift mostly proposed model retraining after observing…

Machine Learning · Computer Science 2020-06-29 Jing Pan , Vincent Pham , Mohan Dorairaj , Huigang Chen , Jeong-Yoon Lee

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently…

Computation and Language · Computer Science 2024-06-17 Hancheol Park , Soyeong Jeong , Sukmin Cho , Jong C. Park

This paper proposes a self-explainable Deep Learning (SE-DL) system for an image classification problem that performs self-error detection. The self-error detection is key to improving the DL system's safe operation, especially in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Mohammad Mahdi Karimi , Azin Heidarshenas , William W. Edmonson

In this study, we propose an innovative dynamic classification algorithm aimed at achieving zero missed detections and minimal false positives,acritical in safety-critical domains (e.g., medical diagnostics) where undetected cases risk…

Machine Learning · Computer Science 2025-06-02 Ziyuan Zhong , Junyang Zhou

Non-stationarity of an underlying data generating process that leads to distributional changes over time is a key characteristic of Data Streams. This phenomenon, commonly referred to as Concept Drift, has been intensively studied, and…

Machine Learning · Computer Science 2026-02-09 Brandon Gower-Winter , Misja Groen , Georg Krempl

The world surrounding us is subject to constant change. These changes, frequently described as concept drift, influence many industrial and technical processes. As they can lead to malfunctions and other anomalous behavior, which may be…

Machine Learning · Computer Science 2023-10-25 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Machine learning (ML)-based malware detectors degrade over time as concept drift introduces new and evolving families unseen during training. Retraining is limited by the cost and time of manual labeling or sandbox analysis. Existing…

Cryptography and Security · Computer Science 2025-11-20 Adrian Shuai Li , Elisa Bertino

Machine unlearning (MU) is a promising cost-effective method to cleanse undesired information (generated concepts, biases, or patterns) from foundational diffusion models. While MU is orders of magnitude less costly than retraining a…

Machine Learning · Computer Science 2025-07-11 Eric Yeats , Darryl Hannan , Henry Kvinge , Timothy Doster , Scott Mahan

We address the problem of concept removal in deep neural networks, aiming to learn representations that do not encode certain specified concepts (e.g., gender etc.) We propose a novel method based on adversarial linear classifiers trained…

Machine Learning · Computer Science 2023-10-10 Yegor Klochkov , Jean-Francois Ton , Ruocheng Guo , Yang Liu , Hang Li

Vision classifiers can exploit spurious correlations, achieving high in-distribution accuracy yet failing under distribution shift. Existing approaches to bias mitigation and analysis often depend on curated datasets, spurious-attribute or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Thomas Vitry , Kieran Edgeworth , Stefan Wermter , Jae Hee Lee