English
Related papers

Related papers: Real-Time Nonparametric Anomaly Detection in High-…

200 papers

Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may…

In this paper we present a novel algorithm and efficient data structure for anomaly detection based on temporal data. Time-series data are represented by a sequence of symbolic time intervals, describing increasing and decreasing trends, in…

Data Structures and Algorithms · Computer Science 2019-11-05 Roni Mateless , Michael Segal , Robert Moskovitch

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

Anomaly detection aims at identifying unexpected fluctuations in the expected behavior of a given system. It is acknowledged as a reliable answer to the identification of zero-day attacks to such extent, several ML algorithms that suit for…

Machine Learning · Computer Science 2020-12-22 Tommaso Zoppi , Andrea ceccarelli , Tommaso Capecchi , Andrea Bondavalli

Power-generating assets (e.g., jet engines, gas turbines) are often instrumented with tens to hundreds of sensors for monitoring physical and performance degradation. Anomaly detection algorithms highlight deviations from predetermined…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-27 Paras Jain , Chirag Tailor , Sam Ford , Liexiao Ding , Michael Phillips , Fang Liu , Nagi Gebraeel , Duen Horng Chau

Nearest-neighbor (NN) procedures are well studied and widely used in both supervised and unsupervised learning problems. In this paper we are concerned with investigating the performance of NN-based methods for anomaly detection. We first…

Machine Learning · Statistics 2019-07-10 Xiaoyi Gu , Leman Akoglu , Alessandro Rinaldo

In a cloud of m-dimensional data points, how would we spot, as well as rank, both single-point- as well as group- anomalies? We are the first to generalize anomaly detection in two dimensions: The first dimension is that we handle both…

Machine Learning · Computer Science 2021-11-17 Meng-Chieh Lee , Shubhranshu Shekhar , Christos Faloutsos , T. Noah Hutson , Leon Iasemidis

River water-quality monitoring is increasingly conducted using automated in situ sensors, enabling timelier identification of unexpected values. However, anomalies caused by technical issues confound these data, while the volume and…

Tables are an abundant form of data with use cases across all scientific fields. Real-world datasets often contain anomalous samples that can negatively affect downstream analysis. In this work, we only assume access to contaminated data…

Machine Learning · Computer Science 2023-07-25 Guy Zamberg , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

Change-point detection has been a classical problem in statistics and econometrics. This work focuses on the problem of detecting abrupt distributional changes in the data-generating distribution of a sequence of high-dimensional…

Methodology · Statistics 2021-05-20 Shubhadeep Chakraborty , Xianyang Zhang

The use of in-situ digital sensors for water quality monitoring is becoming increasingly common worldwide. While these sensors provide near real-time data for science, the data are prone to technical anomalies that can undermine the…

Mechanical devices such as engines, vehicles, aircrafts, etc., are typically instrumented with numerous sensors to capture the behavior and health of the machine. However, there are often external factors or variables which are not captured…

Artificial Intelligence · Computer Science 2016-07-12 Pankaj Malhotra , Anusha Ramakrishnan , Gaurangi Anand , Lovekesh Vig , Puneet Agarwal , Gautam Shroff

Time series anomaly detection is extensively studied in statistics, economics, and computer science. Over the years, numerous methods have been proposed for time series anomaly detection using deep learning-based methods. Many of these…

Machine Learning · Computer Science 2022-08-25 Shahroz Tariq , Binh M. Le , Simon S. Woo

Anomaly detection in database management systems (DBMSs) is difficult because of increasing number of statistics (stat) and event metrics in big data system. In this paper, I propose an automatic DBMS diagnosis system that detects anomaly…

Machine Learning · Statistics 2018-01-26 Doyup Lee

We propose an anomaly detection method for multi-variate scientific data based on analysis of high-order joint moments. Using kurtosis as a reliable measure of outliers, we suggest that principal kurtosis vectors, by analogy to principal…

Computational Physics · Physics 2019-05-01 Konduri Aditya , Hemanth Kolla , W. Philip Kegelmeyer , Timothy M. Shead , Julia Ling , Warren L. Davis

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

Temporal anomaly detection looks for irregularities over space-time. Unsupervised temporal models employed thus far typically work on sequences of feature vectors, and much less on temporal multiway data. We focus our investigation on…

Machine Learning · Computer Science 2020-09-22 Duc Nguyen , Phuoc Nguyen , Kien Do , Santu Rana , Sunil Gupta , Truyen Tran

We present a new algorithm for anomaly detection called Anomaly Awareness. The algorithm learns about normal events while being made aware of the anomalies through a modification of the cost function. We show how this method works in…

Machine Learning · Computer Science 2023-08-02 Charanjit K. Khosa , Veronica Sanz

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

In this paper we propose novel randomized subspace methods to detect anomalies in Internet Protocol networks. Given a data matrix containing information about network traffic, the proposed approaches perform a normal-plus-anomalous matrix…

Information Theory · Computer Science 2017-04-20 M. Kaloorazi , R. C. de Lamare