English
Related papers

Related papers: A Typology of Data Anomalies

200 papers

Data values in a dataset can be missing or anomalous due to mishandling or human error. Analysing data with missing values can create bias and affect the inferences. Several analysis methods, such as principle components analysis or…

Artificial Intelligence · Computer Science 2022-05-11 Sandeep Hans , Diptikalyan Saha , Aniya Aggarwal

Google uses continuous streams of data from industry partners in order to deliver accurate results to users. Unexpected drops in traffic can be an indication of an underlying issue and may be an early warning that remedial action may be…

Machine Learning · Statistics 2017-08-15 Dominique T. Shipmon , Jason M. Gurevitch , Paolo M. Piselli , Stephen T. Edwards

Anomaly detection is the task of identifying rarely occurring (i.e. anormal or anomalous) samples that differ from almost all other samples in a dataset. As the patterns of anormal samples are usually not known a priori, this task is highly…

Applications · Statistics 2025-06-30 Nicolas Thewes , Philipp Steinhauer , Patrick Trampert , Markus Pauly , Georg Schneider

Anomaly detection is a challenging task that frequently arises in practically all areas of industry and science, from fraud detection and data quality monitoring to finding rare cases of diseases and searching for new physics. Most of the…

Machine Learning · Computer Science 2021-11-22 Artem Ryzhikov , Maxim Borisyak , Andrey Ustyuzhanin , Denis Derkach

Anomalies refer to the departure of systems and devices from their normal behaviour in standard operating conditions. An anomaly in an industrial device can indicate an upcoming failure, often in the temporal direction. In this paper, we…

Machine Learning · Computer Science 2024-02-13 Snehanshu Saha , Jyotirmoy Sarkar , Soma Dhavala , Santonu Sarkar , Preyank Mota

Anomaly detection is the task of identifying examples that do not behave as expected. Because anomalies are rare and unexpected events, collecting real anomalous examples is often challenging in several applications. In addition, learning…

Machine Learning · Computer Science 2024-05-24 Lorenzo Perini , Maja Rudolph , Sabrina Schmedding , Chen Qiu

Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event…

Machine Learning · Computer Science 2023-05-16 Max Landauer , Sebastian Onder , Florian Skopik , Markus Wurzenberger

Anomaly detection is a challenging task, particularly in systems with many variables. Anomalies are outliers that statistically differ from the analyzed data and can arise from rare events, malfunctions, or system misuse. This study…

Artificial Intelligence · Computer Science 2023-08-10 Kleyton da Costa

Incipient anomalies present milder symptoms compared to severe ones, and are more difficult to detect and diagnose due to their close resemblance to normal operating conditions. The lack of incipient anomaly examples in the training data…

Machine Learning · Computer Science 2020-08-21 Baihong Jin , Yingshui Tan , Albert Liu , Xiangyu Yue , Yuxin Chen , Alberto Sangiovanni Vincentelli

Detecting anomalies in time series data is a challenging task with broad relevance in many applications. Existing methods work effectively only under idealized conditions, typically focusing on point anomalies or assuming a constant…

Methodology · Statistics 2025-09-01 Yiyin Zhang , Florian Pein , Idris Eckley

Anomaly detection, a.k.a. outlier detection or novelty detection, has been a lasting yet active research area in various research communities for several decades. There are still some unique problem complexities and challenges that require…

Machine Learning · Computer Science 2020-12-08 Guansong Pang , Chunhua Shen , Longbing Cao , Anton van den Hengel

Anomaly detection is concerned with identifying examples in a dataset that do not conform to the expected behaviour. While a vast amount of anomaly detection algorithms exist, little attention has been paid to explaining why these…

Machine Learning · Computer Science 2021-12-14 Nirmal Sobha Kartha , Clément Gautrais , Vincent Vercruyssen

Anomaly detection, finding patterns that substantially deviate from those seen previously, is one of the fundamental problems of artificial intelligence. Recently, classification-based methods were shown to achieve superior results on this…

Machine Learning · Computer Science 2020-05-06 Liron Bergman , Yedid Hoshen

The problem of detecting anomalies in multiple processes is considered. We consider a composite hypothesis case, in which the measurements drawn when observing a process follow a common distribution with an unknown parameter (vector), whose…

Information Theory · Computer Science 2020-04-22 Bar Hemo , Tomer Gafni , Kobi Cohen , Qing Zhao

The Internet of Things (IoT) is a system that connects physical computing devices, sensors, software, and other technologies. Data can be collected, transferred, and exchanged with other devices over the network without requiring human…

Machine Learning · Computer Science 2023-01-03 Eleonora Achiluzzi , Menglu Li , Md Fahd Al Georgy , Rasha Kashef

Anomaly detection in complex domains poses significant challenges due to the need for extensive labeled data and the inherently imbalanced nature of anomalous versus benign samples. Graph-based machine learning models have emerged as a…

Machine Learning · Computer Science 2025-07-21 Yifan Wei , Anwar Said , Waseem Abbas , Xenofon Koutsoukos

This paper presents a simple yet effective method for anomaly detection. The main idea is to learn small perturbations to perturb normal data and learn a classifier to classify the normal data and the perturbed data into two different…

Machine Learning · Computer Science 2023-02-07 Jinyu Cai , Jicong Fan

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

Machine Learning · Computer Science 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

The goal of anomaly detection is to identify anomalous samples from normal ones. In this paper, a small number of anomalies are assumed to be available at the training stage, but they are assumed to be collected only from several anomaly…

Machine Learning · Computer Science 2022-05-03 Bowen Tian , Qinliang Su , Jian Yin

Anomaly detection is the process of identifying atypical data samples that significantly deviate from the majority of the dataset. In the realm of clinical screening and diagnosis, detecting abnormalities in medical images holds great…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Xianyao Hu , Congming Jin