English
Related papers

Related papers: The Inverse Bagging Algorithm: Anomaly Detection b…

200 papers

Probabilistic graphical models are graphical representations of probability distributions. Graphical models have applications in many fields including biology, social sciences, linguistic, neuroscience. In this paper, we propose directed…

Machine Learning · Statistics 2014-06-10 Ru Wang , Jie Peng

We propose a new method to define anomaly scores and apply this to particle physics collider events. Anomalies can be either rare, meaning that these events are a minority in the normal dataset, or different, meaning they have values that…

High Energy Physics - Phenomenology · Physics 2022-03-09 Sascha Caron , Luc Hendriks , Rob Verheyen

In this paper, we propose a bootstrap method applied to massive data processed distributedly in a large number of machines. This new method is computationally efficient in that we bootstrap on the master machine without over-resampling,…

Machine Learning · Statistics 2020-02-21 Yang Yu , Shih-Kang Chao , Guang Cheng

Anomaly detection is a key application of machine learning, but is generally focused on the detection of outlying samples in the low probability density regions of data. Here we instead present and motivate a method for unsupervised…

Machine Learning · Computer Science 2020-12-23 George Stein , Uros Seljak , Biwei Dai

Anomaly detection to recognize unusual events in large scale systems in a time sensitive manner is critical in many industries, eg. bank fraud, enterprise systems, medical alerts, etc. Large-scale systems often grow in size and complexity…

Machine Learning · Computer Science 2022-10-31 Srishti Mishra , Tvarita Jain , Dinkar Sitaram

In this paper we study a bootstrap strategy for estimating the variance of a mean taken over large multifactor crossed random effects data sets. We apply bootstrap reweighting independently to the levels of each factor, giving each…

Methodology · Statistics 2012-09-28 Art B. Owen , Dean Eckles

The parametric bootstrap can be used for the efficient computation of Bayes posterior distributions. Importance sampling formulas take on an easy form relating to the deviance in exponential families and are particularly simple starting…

Applications · Statistics 2013-01-15 Bradley Efron

Bootstrap techniques (also called resampling computation techniques) have introduced new advances in modeling and model evaluation. Using resampling methods to construct a series of new samples which are based on the original data set,…

Statistics Theory · Mathematics 2007-06-13 Riadh Kallel , Marie Cottrell , Vincent Vigneron

Anomaly detection plays an important role in modern data-driven security applications, such as detecting suspicious access to a socket from a process. In many cases, such events can be described as a collection of categorical values that…

Machine Learning · Computer Science 2016-08-29 Ting Chen , Lu-An Tang , Yizhou Sun , Zhengzhang Chen , Kai Zhang

The one-step replica symmetry breaking cavity method is proposed as a new tool to investigate large deviations in random graph ensembles. The procedure hinges on a general connection between negative complexities and probabilities of rare…

Statistical Mechanics · Physics 2009-11-10 Olivier Rivoire

Mining information from logs is an old and still active research topic. In recent years, with the rapid emerging of cloud computing, log mining becomes increasingly important to industry. This paper focus on one major mission of log mining:…

Machine Learning · Computer Science 2011-09-09 Nan Wang , Jizhong Han , Jinyun Fang

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

Large-scale data analysis poses both statistical and computational problems which need to be addressed simultaneously. A solution is often straightforward if the data are homogeneous: one can use classical ideas of subsampling and mean…

Methodology · Statistics 2014-09-10 Peter Bühlmann , Nicolai Meinshausen

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different…

Machine Learning · Computer Science 2021-03-31 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

We consider the paradigm of unsupervised anomaly detection, which involves the identification of anomalies within a dataset in the absence of labeled examples. Though distance-based methods are top-performing for unsupervised anomaly…

Machine Learning · Statistics 2025-08-04 Yuchao Cai , Hanfang Yang , Yuheng Ma , Hanyuan Hang

Abnormalities of the sewage pipe network will affect the normal operation of the whole city. Therefore, it is important to detect the abnormalities early. This paper propose an early abnormal-detection method. The abnormalities are detected…

Machine Learning · Computer Science 2022-06-08 Zhen-Yu Zhang , Guo-Xiang Shao , Chun-Ming Qiu , Yue-Jie Hou , En-Ming Zhao , Chi-Chun Zhou

In statistical exercises where there are several candidate models, the traditional approach is to select one model using some data driven criterion and use that model for estimation, testing and other purposes, ignoring the variability of…

Statistics Theory · Mathematics 2008-12-18 Snigdhansu Chatterjee , Nitai D. Mukhopadhyay

Robot introspection, as opposed to anomaly detection typical in process monitoring, helps a robot understand what it is doing at all times. A robot should be able to identify its actions not only when failure or novelty occurs, but also as…

Robotics · Computer Science 2018-01-23 Hongmin Wu , Hongbin Lin , Yisheng Guan , Kensuke Harada , Juan Rojas

We propose a nonparametric bootstrap procedure for two-phase stratified sampling without replacement. In this design, a weighted likelihood estimator is known to have smaller asymptotic variance than under the convenient assumption of…

Statistics Theory · Mathematics 2014-09-26 Takumi Saegusa