English
Related papers

Related papers: Detecting Dataset Drift and Non-IID Sampling via k…

200 papers

In the $k$-nearest neighborhood model ($k$-NN), we are given a set of points $P$, and we shall answer queries $q$ by returning the $k$ nearest neighbors of $q$ in $P$ according to some metric. This concept is crucial in many areas of data…

Machine Learning · Computer Science 2018-12-03 Hendrik Fichtenberger , Dennis Rohde

Concept drift is a phenomenon in which the distribution of a data stream changes over time in unforeseen ways, causing prediction models built on historical data to become inaccurate. While a variety of automated methods have been developed…

Machine Learning · Computer Science 2023-08-10 Weikai Yang , Zhen Li , Mengchen Liu , Yafeng Lu , Kelei Cao , Ross Maciejewski , Shixia Liu

Drift is a significant issue that undermines the reliability of gas sensors. This paper introduces a probabilistic model to distinguish between environmental variation and instrumental drift, using low-cost non-dispersive infrared (NDIR)…

Signal Processing · Electrical Eng. & Systems 2025-02-07 Cheng Yang , Gustav Bohlin , Tobias Oechtering

Distributional drift detection is important in medical applications as it helps ensure the accuracy and reliability of models by identifying changes in the underlying data distribution that could affect the prediction results of machine…

Image and Video Processing · Electrical Eng. & Systems 2025-05-12 Yusen Wu , Phuong Nguyen , Rose Yesha , Yelena Yesha

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

Machine learning, statistical-based, and knowledge-based methods are often used to implement an Anomaly-based Intrusion Detection System which is software that helps in detecting malicious and undesired activities in the network primarily…

Cryptography and Security · Computer Science 2023-03-01 Vusumuzi Malele , Topside E Mathonsi

Computer programs often behave differently under different compilers or in different computing environments. Relative debugging is a collection of techniques by which these differences are analysed. Differences may arise because of…

Software Engineering · Computer Science 2013-04-12 John Collins , Brian Farrimond , David Flower , Mark Anderson , David Gill

Reliable out-of-distribution (OOD) detection is fundamental to implementing safer modern machine learning (ML) systems. In this paper, we introduce Igeood, an effective method for detecting OOD samples. Igeood applies to any pre-trained…

Machine Learning · Statistics 2022-03-16 Eduardo Dadalto Camara Gomes , Florence Alberge , Pierre Duhamel , Pablo Piantanida

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

Concept drift detection has attracted considerable attention due to its importance in many real-world applications such as health monitoring and fault diagnosis. Conventionally, most advanced approaches will be of poor performance when the…

Machine Learning · Computer Science 2023-03-31 Songqiao Hu , Zeyi Liu , Xiao He

Millions of vulnerable consumer IoT devices in home networks are the enabler for cyber crimes putting user privacy and Internet security at risk. Internet service providers (ISPs) are best poised to play key roles in mitigating risks by…

In image classification, a lot of development has happened in detecting out-of-distribution (OoD) data. However, most OoD detection methods are evaluated on a standard set of datasets, arbitrarily different from training data. There is no…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Jishnu Mukhoti , Tsung-Yu Lin , Bor-Chun Chen , Ashish Shah , Philip H. S. Torr , Puneet K. Dokania , Ser-Nam Lim

Out-of-distribution (OOD) detection is concerned with identifying data points that do not belong to the same distribution as the model's training data. For the safe deployment of predictive models in a real-world environment, it is critical…

Sound · Computer Science 2023-02-28 Zaharah Bukhsh , Aaqib Saeed

This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD), an extension of the Optimal Transport distance. The approach addresses the challenges of detecting distributional…

Methodology · Statistics 2025-06-23 Zhengqi Lin , Yan Chen

Anomalies are strange data points; they usually represent an unusual occurrence. Anomaly detection is presented from the perspective of Wireless sensor networks. Different approaches have been taken in the past, as we will see, not only to…

Machine Learning · Computer Science 2017-08-30 Pelumi Oluwasanya

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

We introduce a new approach, called Isolate-Detect (ID), for the consistent estimation of the number and location of multiple generalized change-points in noisy data sequences. Examples of signal changes that ID can deal with are changes in…

Methodology · Statistics 2021-06-02 Andreas Anastasiou , Piotr Fryzlewicz

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

Machine Learning · Computer Science 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Estimating mutual information from i.i.d. samples drawn from an unknown joint density function is a basic statistical problem of broad interest with multitudinous applications. The most popular estimator is one proposed by Kraskov and…

Machine Learning · Computer Science 2016-08-11 Weihao Gao , Sewoong Oh , Pramod Viswanath