English
Related papers

Related papers: Anomaly detection using surprisals

200 papers

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

Machine Learning · Computer Science 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

The goal of anomaly detection is to identify anomalous samples from normal ones. In this paper, a small number of anomalies are assumed to be available at the training stage, but they are assumed to be collected only from several anomaly…

Machine Learning · Computer Science 2022-05-03 Bowen Tian , Qinliang Su , Jian Yin

Deep generative models for anomaly detection in multivariate time-series are typically trained by maximizing data likelihood. However, likelihood in observation space measures marginal density rather than conformity to structured temporal…

Artificial Intelligence · Computer Science 2026-03-13 David Baumgartner , Eliezer de Souza da Silva , Iñigo Urteaga

Modelling excesses over a high threshold using the Pareto or generalized Pareto distribution (PD/GPD) is the most popular approach in extreme value statistics. This method typically requires high thresholds in order for the (G)PD to fit…

Statistics Theory · Mathematics 2009-01-13 Jan Beirlant , Elisabeth Joossens , Johan Segers

Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly…

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

The task of detecting anomalous data patterns is as important in practical applications as challenging. In the context of spatial data, recognition of unexpected trajectories brings additional difficulties, such as high dimensionality and…

Most anomaly detection systems try to model normal behavior and assume anomalies deviate from it in diverse manners. However, there may be patterns in the anomalies as well. Ideally, an anomaly detection system can exploit patterns in both…

Machine Learning · Computer Science 2023-05-23 Jonas Soenen , Elia Van Wolputte , Vincent Vercruyssen , Wannes Meert , Hendrik Blockeel

Anomalies can be defined as any non-random structure which deviates from normality. Anomaly detection methods reported in the literature are numerous and diverse, as what is considered anomalous usually varies depending on particular…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Matias Tailanian , Pablo Musé , Álvaro Pardo

In one-class-learning tasks, only the normal case (foreground) can be modeled with data, whereas the variation of all possible anomalies is too erratic to be described by samples. Thus, due to the lack of representative data, the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Duc Tam Nguyen , Zhongyu Lou , Michael Klar , Thomas Brox

Unsupervised anomaly detection is a daunting task, as it relies solely on normality patterns from the training data to identify unseen anomalies during testing. Recent approaches have focused on leveraging domain-specific transformations or…

Machine Learning · Computer Science 2024-09-17 Hyuntae Kim , Changhee Lee

This article introduces a non-parametric information-theoretic approach to inference about the tail of a continuous or a discrete distribution. Leveraging a new concept named tail profile -- a set of information-theoretic quantities…

Applications · Statistics 2025-03-19 Jialin Zhang , Zhiyi Zhang

The task for a general and useful classification of the tail behaviors of probability distributions still has no satisfactory solution. Due to lack of information outside the range of the data the tails of the distribution should be…

Probability · Mathematics 2019-07-23 Pavlina Jordanova

Anomaly detection is the task of identifying examples that do not behave as expected. Because anomalies are rare and unexpected events, collecting real anomalous examples is often challenging in several applications. In addition, learning…

Machine Learning · Computer Science 2024-05-24 Lorenzo Perini , Maja Rudolph , Sabrina Schmedding , Chen Qiu

Methods for unsupervised anomaly detection suffer from the fact that the data is unlabeled, making it difficult to assess the optimality of detection algorithms. Ensemble learning has shown exceptional results in classification and…

Machine Learning · Statistics 2016-10-26 Edward Yu , Parth Parekh

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

Tables are an abundant form of data with use cases across all scientific fields. Real-world datasets often contain anomalous samples that can negatively affect downstream analysis. In this work, we only assume access to contaminated data…

Machine Learning · Computer Science 2023-07-25 Guy Zamberg , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

Detecting rare events is essential in various fields, e.g., in cyber security or maintenance. Often, human experts are supported by anomaly detection systems as continuously monitoring the data is an error-prone and tedious task. However,…

Machine Learning · Computer Science 2023-02-08 Max Schemmer , Joshua Holstein , Niklas Bauer , Niklas Kühl , Gerhard Satzger

This article discusses modelling of the tail of a multivariate distribution function by means of a large deviation principle (LDP), and its application to the estimation of the probability of a multivariate extreme event from a sample of n…

Statistics Theory · Mathematics 2017-02-23 Cees de Valk

A method for unsupervised contextual anomaly detection is proposed using a cross-linked pair of Variational Auto-Encoders for assigning a normality score to an observation. The method enables a distinct separation of contextual from…

Machine Learning · Statistics 2019-04-02 Yaniv Shulman