English
Related papers

Related papers: Anomaly Detection based on Markov Data: A Statisti…

200 papers

One of the contemporary challenges in anomaly detection is the ability to detect, and differentiate between, both point and collective anomalies within a data sequence or time series. The anomaly package has been developed to provide users…

Applications · Statistics 2024-01-30 Alex Fisch , Daniel Grose , Idris A. Eckley , Paul Fearnhead , Lawrence Bardwell

We propose a new approach for estimating the finite dimensional transition matrix of a Markov chain using a large number of independent sample paths observed at random times. The sample paths may be observed as few as two times, and the…

Methodology · Statistics 2025-05-20 Daphne Aurouet , Valentin Patilea

Data-driven anomaly detection methods typically build a model for the normal behavior of the target system, and score each data instance with respect to this model. A threshold is invariably needed to identify data instances with high (or…

Machine Learning · Statistics 2019-10-09 Sreelekha Guggilam , S. M. Arshad Zaidi , Varun Chandola , Abani Patra

Although precision and recall are standard performance measures for anomaly detection, their statistical properties in sequential detection settings are poorly understood. In this work, we formalize a notion of precision and recall with…

Machine Learning · Computer Science 2020-08-14 Erik Scharwächter , Emmanuel Müller

Great progress has been achieved in the community of autonomous driving in the past few years. As a safety-critical problem, however, anomaly detection is a huge hurdle towards a large-scale deployment of autonomous vehicles in the real…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Daniel Bogdoll , Meng Zhang , Maximilian Nitsche , J. Marius Zöllner

We consider quantile estimation using Markov chain Monte Carlo and establish conditions under which the sampling distribution of the Monte Carlo error is approximately Normal. Further, we investigate techniques to estimate the associated…

Statistics Theory · Mathematics 2018-04-20 Charles Doss , James M. Flegal , Galin L. Jones , Ronald C. Neath

In this paper we consider the problem of graph-based transductive classification, and we are particularly interested in the directed graph scenario which is a natural form for many real world applications. Different from existing research…

Computer Vision and Pattern Recognition · Computer Science 2014-03-19 Jaydeep De , Xiaowei Zhang , Li Cheng

This paper aims at formulating the issue of ranking multivariate unlabeled observations depending on their degree of abnormality as an unsupervised statistical learning task. In the 1-d situation, this problem is usually tackled by means of…

Machine Learning · Statistics 2018-09-05 Stephan Clémençon , Albert Thomas

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes a subset of the processes at any given time instant and obtains a noisy binary indicator…

Machine Learning · Computer Science 2021-12-10 Geethu Joseph , Chen Zhong , M. Cenk Gursoy , Senem Velipasalar , Pramod K. Varshney

In this paper we propose a novel variance reduction approach for additive functionals of Markov chains based on minimization of an estimate for the asymptotic variance of these functionals over suitable classes of control variates. A…

Statistics Theory · Mathematics 2020-02-18 D. Belomestny , L. Iosipoi , E. Moulines , A. Naumov , S. Samsonov

Anomaly detection is crucial in industrial applications for identifying rare and unseen patterns to ensure system reliability. Traditional models, trained on a single class of normal data, struggle with real-world distributions where normal…

Machine Learning · Statistics 2026-01-07 Jungi Lee , Jungkwon Kim , Chi Zhang , Sangmin Kim , Kwangsun Yoo , Seok-Joo Byun

Mean absolute deviation function is used to explore the pattern and the distribution of the data graphically to enable analysts gaining greater understanding of raw data and to foster quick and a deep understanding of the data as an…

Methodology · Statistics 2022-06-22 Elsayed A. H. Elamir

The design of a metric between probability distributions is a longstanding problem motivated by numerous applications in Machine Learning. Focusing on continuous probability distributions on the Euclidean space $\mathbb{R}^d$, we introduce…

Objective detection of specific patterns in statistical distributions, like groupings or gaps or abrupt transitions between different subsets, is a task with a rich range of applications in astronomy: Milky Way stellar population analysis,…

Instrumentation and Methods for Astrophysics · Physics 2018-05-09 Roman V. Baluev

The complexity of modern electro-mechanical systems require the development of sophisticated diagnostic methods like anomaly detection capable of detecting deviations. Conventional anomaly detection approaches like signal processing and…

Machine Learning · Computer Science 2025-01-07 Abhishek Srinivasan , Varun Singapuri Ravi , Juan Carlos Andresen , Anders Holst

This paper gives a method for computing distributions associated with patterns in the state sequence of a hidden Markov model, conditional on observing all or part of the observation sequence. Probabilities are computed for very general…

Methodology · Statistics 2007-12-18 John A. D. Aston , Donald E. K. Martin

The utilization of statistical methods an their applications within the new field of study known as Topological Data Analysis has has tremendous potential for broadening our exploration and understanding of complex, high-dimensional data…

Applications · Statistics 2016-07-19 Patrick S. Medina , R. W. Doerge

Complex systems which can be represented in the form of static and dynamic graphs arise in different fields, e.g. communication, engineering and industry. One of the interesting problems in analysing dynamic network structures is to monitor…

Machine Learning · Computer Science 2020-11-13 Anna Malinovskaya , Philipp Otto , Torben Peters

We consider the problem of efficient on-line anomaly detection in computer network traffic. The problem is approached statistically, as that of sequential (quickest) changepoint detection. A multi-cyclic setting of quickest change detection…

Applications · Statistics 2013-07-23 Alexander G. Tartakovsky , Aleksey S. Polunchenko , Grigory Sokolov

Anomaly detection has a wide range of real-world applications, such as bank fraud detection and cyber intrusion detection. In the past decade, a variety of anomaly detection models have been developed, which lead to big progress towards…

Machine Learning · Computer Science 2022-02-17 Shuhan Yuan , Xintao Wu