English
Related papers

Related papers: Anomaly Detection in Big Data

200 papers

This paper introduces a new methodology for detecting anomalies in time series data, with a primary application to monitoring the health of (micro-) services and cloud resources. The main novelty in our approach is that instead of modeling…

Machine Learning · Computer Science 2020-07-31 Fadhel Ayed , Lorenzo Stella , Tim Januschowski , Jan Gasthaus

The problem of detecting data anomaly is considered. Under the null hypothesis that models anomaly-free data, measurements are assumed to be from an unknown distribution with some authenticated historical samples. Under the composite…

Machine Learning · Computer Science 2020-01-27 Kursat Rasim Mestav , Lang Tong

Anomaly and failure detection methods are crucial in identifying deviations from normal system operational conditions, which allows for actions to be taken in advance, usually preventing more serious damages. Long-lasting deviations…

Machine Learning · Computer Science 2026-03-20 Natalia Wojak-Strzelecka , Szymon Bobek , Grzegorz J. Nalepa , Jerzy Stefanowski

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

Anomaly detection in data analysis is an interesting but still challenging research topic in real world applications. As the complexity of data dimension increases, it requires to understand the semantic contexts in its description for…

Machine Learning · Computer Science 2020-11-18 Gahye Lee , Seungkyu Lee

Detecting anomalies in data is a vital task, with numerous high-impact applications in areas such as security, finance, health care, and law enforcement. While numerous techniques have been developed in past years for spotting outliers and…

Social and Information Networks · Computer Science 2014-04-29 Leman Akoglu , Hanghang Tong , Danai Koutra

This paper presents a simple yet effective method for anomaly detection. The main idea is to learn small perturbations to perturb normal data and learn a classifier to classify the normal data and the perturbed data into two different…

Machine Learning · Computer Science 2023-02-07 Jinyu Cai , Jicong Fan

Anomaly detection is the task of detecting data which differs from the normal behaviour of a system in a given context. In order to approach this problem, data-driven models can be learned to predict current or future observations.…

Machine Learning · Computer Science 2020-10-30 Benedikt Eiteneuer , Oliver Niggemann

Anomaly detection is a classical problem in computer vision, namely the determination of the normal from the abnormal when datasets are highly biased towards one class (normal) due to the insufficient sample size of the other class…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Samet Akcay , Amir Atapour-Abarghouei , Toby P. Breckon

In medical imaging, obtaining large amounts of labeled data is often a hurdle, because annotations and pathologies are scarce. Anomaly detection is a method that is capable of detecting unseen abnormal data while only being trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Djennifer K. Madzia-Madzou , Hugo J. Kuijf

Streaming anomaly detection refers to the problem of detecting anomalous data samples in streams of data. This problem poses challenges that classical and deep anomaly detection methods are not designed to cope with, such as conceptual…

Machine Learning · Computer Science 2022-10-12 Joseph Gallego-Mejia , Oscar Bustos-Brinez , Fabio Gonzalez

Anomaly detection is a relevant problem in the area of data analysis. In networked systems, where individual entities interact in pairs, anomalies are observed when pattern of interactions deviates from patterns considered regular. Properly…

Social and Information Networks · Computer Science 2023-10-25 Hadiseh Safdari , Caterina De Bacco

Data-driven anomaly detection methods typically build a model for the normal behavior of the target system, and score each data instance with respect to this model. A threshold is invariably needed to identify data instances with high (or…

Machine Learning · Statistics 2019-10-09 Sreelekha Guggilam , S. M. Arshad Zaidi , Varun Chandola , Abani Patra

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Anomalies refer to data points or events that deviate from normal and homogeneous events, which can include fraudulent activities, network infiltrations, equipment malfunctions, process changes, or other significant but infrequent events.…

Machine Learning · Computer Science 2023-03-20 Ahmed Shoyeb Raihan , Imtiaz Ahmed

The detection and the quantification of anomalies in image data are critical tasks in industrial scenes such as detecting micro scratches on product. In recent years, due to the difficulty of defining anomalies and the limit of correcting…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Masanari Kimura , Takashi Yanagihara

Anomaly detection aims to detect abnormal events by a model of normality. It plays an important role in many domains such as network intrusion detection, criminal activity identity and so on. With the rapidly growing size of accessible…

Machine Learning · Computer Science 2018-08-02 Chu Wang , Yan-Ming Zhang , Cheng-Lin Liu

Power system state estimation is being faced with different types of anomalies. These might include bad data caused by gross measurement errors or communication system failures. Sudden changes in load or generation can be considered as…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Sajjad Asefi , Mile Mitrovic , Dragan Ćetenović , Victor Levi , Elena Gryazina , Vladimir Terzija

Anomaly detection methods are part of the systems where rare events may endanger an operation's profitability, safety, and environmental aspects. Although many state-of-the-art anomaly detection methods were developed to date, their…

Machine Learning · Computer Science 2023-02-01 Marek Wadinger , Michal Kvasnica

The problem of identifying anomalies in dynamic networks is a fundamental task with a wide range of applications. However, it raises critical challenges due to the complex nature of anomalies, lack of ground truth knowledge, and complex and…

Machine Learning · Computer Science 2022-11-16 Ali Behrouz , Margo Seltzer