English
Related papers

Related papers: A Typology of Data Anomalies

200 papers

Anomaly detection, a critical facet in data analysis, involves identifying patterns that deviate from expected behavior. This research addresses the complexities inherent in anomaly detection, exploring challenges and adapting to…

Machine Learning · Computer Science 2024-05-07 Aditya Singh , Pavan Reddy

Data-driven methods that detect anomalies in times series data are ubiquitous in practice, but they are in general unable to provide helpful explanations for the predictions they make. In this work we propose a model-agnostic algorithm that…

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

Daily operation of a large-scale experiment is a resource consuming task, particularly from perspectives of routine data quality monitoring. Typically, data comes from different sub-detectors and the global quality of data depends on the…

Data Analysis, Statistics and Probability · Physics 2017-11-21 V. Azzolini , M. Borisyak , G. Cerminara , D. Derkach , G. Franzoni , F. De Guio , O. Koval , M. Pierini , A. Pol , F. Ratnikov , F. Siroky , A. Ustyuzhanin , J-R. Vlimant

The ability to quickly and accurately detect anomalous structure within data sequences is an inference challenge of growing importance. This work extends recently proposed post-hoc (offline) anomaly detection methodology to the sequential…

Methodology · Statistics 2020-09-16 Alexander T. M. Fisch , Lawrence Bardwell , Idris A. Eckley

Recent advances in technology have brought major breakthroughs in data collection, enabling a large amount of data to be gathered over time and thus generating time series. Mining this data has become an important task for researchers and…

Machine Learning · Computer Science 2020-02-12 Ane Blázquez-García , Angel Conde , Usue Mori , Jose A. Lozano

Anomaly detection is a fundamental problem in data mining field with many real-world applications. A vast majority of existing anomaly detection methods predominately focused on data collected from a single source. In real-world…

Machine Learning · Computer Science 2019-08-13 Yuening Li , Ninghao Liu , Jundong Li , Mengnan Du , Xia Hu

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for…

Machine Learning · Statistics 2021-01-13 Peter J. Rousseeuw , Mia Hubert

Real-world graphs are complex to process for performing effective analysis, such as anomaly detection. However, recently, there have been several research efforts addressing the issues surrounding graph-based anomaly detection. In this…

Machine Learning · Computer Science 2024-05-13 Prabin B Lamichhane , William Eberle

Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The presence of anomalies can indicate novel or unexpected events, such as production faults, system…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Anomaly detection aims at identifying unexpected fluctuations in the expected behavior of a given system. It is acknowledged as a reliable answer to the identification of zero-day attacks to such extent, several ML algorithms that suit for…

Machine Learning · Computer Science 2020-12-22 Tommaso Zoppi , Andrea ceccarelli , Tommaso Capecchi , Andrea Bondavalli

Detecting abnormal patterns that deviate from a certain regular repeating pattern in time series is essential in many big data applications. However, the lack of labels, the dynamic nature of time series data, and unforeseeable abnormal…

Machine Learning · Computer Science 2023-07-06 Bin Li , Carsten Jentsch , Emmanuel Müller

Many social and economic systems can be represented as attributed networks encoding the relations between entities who are themselves described by different node attributes. Finding anomalies in these systems is crucial for detecting abuses…

Social and Information Networks · Computer Science 2020-10-27 Leonardo Gutiérrez-Gómez , Alexandre Bovet , Jean-Charles Delvenne

Anomaly detection is crucial for understanding unusual behaviors in data, as anomalies offer valuable insights. This paper introduces Dependency-based Anomaly Detection (DepAD), a general framework that utilizes variable dependencies to…

Machine Learning · Computer Science 2024-04-18 Sha Lu , Lin Liu , Kui Yu , Thuc Duy Le , Jixue Liu , Jiuyong Li

Computer algorithms are written with the intent that when run they perform a useful function. Typically any information obtained is unknown until the algorithm is run. However, if the behavior of an algorithm can be fully described by…

Machine Learning · Computer Science 2018-10-22 Ian J Davis

The HDoutliers algorithm is a powerful unsupervised algorithm for detecting anomalies in high-dimensional data, with a strong theoretical foundation. However, it suffers from some limitations that significantly hinder its performance level,…

Machine Learning · Statistics 2019-08-13 Priyanga Dilini Talagala , Rob J. Hyndman , Kate Smith-Miles

Anomaly detection for time-series data has been an important research field for a long time. Seminal work on anomaly detection methods has been focussing on statistical approaches. In recent years an increasing number of machine learning…

Machine Learning · Computer Science 2020-04-02 Mohammad Braei , Sebastian Wagner

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

Anomaly detection is a longstanding and active research area that has many applications in domains such as finance, security, and manufacturing. However, the efficiency and performance of anomaly detection algorithms are challenged by the…

Machine Learning · Computer Science 2025-04-16 Yang Cao , Haolong Xiang , Hang Zhang , Ye Zhu , Kai Ming Ting