English
Related papers

Related papers: Anomaly Detection in Big Data

200 papers

The problem of sequential anomaly detection and identification is considered, where multiple data sources are simultaneously monitored and the goal is to identify in real time those, if any, that exhibit ``anomalous" statistical behavior.…

Statistics Theory · Mathematics 2024-12-09 Aristomenis Tsopelakos , Georgios Fellouris

The definition of anomaly detection is the identification of an unexpected event. Real-time detection of extreme events such as wildfires, cyclones, or floods using satellite data has become crucial for disaster management. Although several…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Akash Awasthi , Son Ly , Jaer Nizam , Samira Zare , Videet Mehta , Safwan Ahmed , Keshav Shah , Ramakrishna Nemani , Saurabh Prasad , Hien Van Nguyen

Intrusion detection for computer network systems becomes one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to its valuable resources on computer…

Machine Learning · Computer Science 2017-03-30 Loic Bontemps , Van Loi Cao , James McDermott , Nhien-An Le-Khac

To ensure reliability and service availability, next-generation networks are expected to rely on automated anomaly detection systems powered by advanced machine learning methods with the capability of handling multi-dimensional data. Such…

Machine Learning · Computer Science 2026-01-07 Mahsa Raeiszadeh , Amin Ebrahimzadeh , Roch H. Glitho , Johan Eker , Raquel A. F. Mini

Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Nina Shvetsova , Bart Bakker , Irina Fedulova , Heinrich Schulz , Dmitry V. Dylov

Large-scale monitoring, anomaly detection, and root cause analysis of metrics are essential requirements of the internet-services industry. To address the need to continuously monitor millions of metrics, many anomaly detection approaches…

Machine Learning · Computer Science 2022-03-18 Nikhil Galagali

We address an anomaly detection setting in which training sequences are unavailable and anomalies are scored independently of temporal ordering. Current algorithms in anomaly detection are based on the classical density estimation approach…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Allison Del Giorno , J. Andrew Bagnell , Martial Hebert

Time series anomalies can offer information relevant to critical situations facing various fields, from finance and aerospace to the IT, security, and medical domains. However, detecting anomalies in time series data is particularly…

Machine Learning · Computer Science 2020-11-17 Alexander Geiger , Dongyu Liu , Sarah Alnegheimish , Alfredo Cuesta-Infante , Kalyan Veeramachaneni

Detection of anomalies among a large number of processes is a fundamental task that has been studied in multiple research areas, with diverse applications spanning from spectrum access to cyber-security. Anomalous events are characterized…

Information Theory · Computer Science 2022-08-12 Benjamin Wolff , Tomer Gafni , Guy Revach , Nir Shlezinger , Kobi Cohen

Given a stream of entries over time in a multi-dimensional data setting where concept drift is present, how can we detect anomalous activities? Most of the existing unsupervised anomaly detection approaches seek to detect anomalous events…

Machine Learning · Computer Science 2022-03-07 Siddharth Bhatia , Arjit Jain , Shivin Srivastava , Kenji Kawaguchi , Bryan Hooi

Anomaly detection involves identifying instances within a dataset that deviate from the norm and occur infrequently. Current benchmarks tend to favor methods biased towards low diversity in normal data, which does not align with real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mohammad Akhavan Anvari , Rojina Kashefi , Vahid Reza Khazaie , Mohammad Khalooei , Mohammad Sabokrou

Anomaly detection in process mining focuses on identifying anomalous cases or events in process executions. The resulting diagnostics are used to provide measures to prevent fraudulent behavior, as well as to derive recommendations for…

Machine Learning · Computer Science 2022-03-21 Suhwan Lee , Xixi Lu , Hajo A. Reijers

A computational workflow, also known as workflow, consists of tasks that must be executed in a specific order to attain a specific goal. Often, in fields such as biology, chemistry, physics, and data science, among others, these workflows…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-14 George Papadimitriou , Hongwei Jin , Cong Wang , Rajiv Mayani , Krishnan Raghavan , Anirban Mandal , Prasanna Balaprakash , Ewa Deelman

As the communication industry has connected distant corners of the globe using advances in network technology, intruders or attackers have also increased attacks on networking infrastructure commensurately. System administrators can attempt…

Cryptography and Security · Computer Science 2012-11-21 Monowar H. Bhuyan , D. K. Bhattacharyya , J. K. Kalita

In data systems, activities or events are continuously collected in the field to trace their proper executions. Logging, which means recording sequences of events, can be used for analyzing system failures and malfunctions, and identifying…

Machine Learning · Computer Science 2021-06-29 Tomer Meirman , Roni Stern , Gilad Katz

Multivariate anomaly detection finds its importance in diverse applications. Despite the existence of many detectors to solve this problem, one cannot simply define why an obtained anomaly inferred by the detector is anomalous. This…

Machine Learning · Computer Science 2025-01-14 Ebenezer R. H. P. Isaac , Joseph H. R. Isaac

Ensuring secure and reliable operations of the power grid is a primary concern of system operators. Phasor measurement units (PMUs) are rapidly being deployed in the grid to provide fast-sampled operational data that should enable quicker…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Christopher Hannon , Deepjyoti Deka , Dong Jin , Marc Vuffray , Andrey Y. Lokhov

Anomaly detection in surveillance videos is attracting an increasing amount of attention. Despite the competitive performance of recent methods, they lack theoretical performance analysis, particularly due to the complex deep neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Keval Doshi , Yasin Yilmaz

Enormous amounts of data are being produced everyday by sub-meters and smart sensors installed in residential buildings. If leveraged properly, that data could assist end-users, energy producers and utility companies in detecting anomalous…

Computers and Society · Computer Science 2021-02-15 Yassine Himeur , Khalida Ghanem , Abdullah Alsalemi , Faycal Bensaali , Abbes Amira

Reliability is a cumbersome problem in High Performance Computing Systems and Data Centers evolution. During operation, several types of fault conditions or anomalies can arise, ranging from malfunctioning hardware to improper…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-30 Andrea Borghesi , Antonio Libri , Luca Benini , Andrea Bartolini