English
Related papers

Related papers: A method for outlier detection based on cluster an…

200 papers

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is…

Machine Learning · Computer Science 2022-05-10 Penny Chong , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

Event sequence data record the occurrences of events in continuous time. Event sequence forecasting based on temporal point processes (TPPs) has been extensively studied, but outlier or anomaly detection, especially without any supervision…

Machine Learning · Computer Science 2024-11-26 Somjit Nath , Yik Chau Lui , Siqi Liu

How can we detect outliers, both scattered and clustered, and also explicitly assign them to respective micro-clusters, without knowing apriori how many micro-clusters exist? How can we perform both tasks in-house, i.e., without any…

Machine Learning · Computer Science 2022-10-18 Shuli Jiang , Robson Leonardo Ferreira Cordeiro , Leman Akoglu

Outlier detection is the identification of points in a dataset that do not conform to the norm. Outlier detection is highly sensitive to the choice of the detection algorithm and the feature subspace used by the algorithm. Extracting…

Artificial Intelligence · Computer Science 2017-05-18 Yanjie Fu , Charu Aggarwal , Srinivasan Parthasarathy , Deepak S. Turaga , Hui Xiong

Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive data series often have common daily patterns that are repeated between similar days or seasons and shared among…

Methodology · Statistics 2022-10-10 A. Elías , J. M. Morales , S. Pineda

Anomaly detection aims to detect data that do not conform to regular patterns, and such data is also called outliers. The anomalies to be detected are often tiny in proportion, containing crucial information, and are suitable for…

Machine Learning · Computer Science 2023-06-06 Fan Xu , Nan Wang , Xibin Zhao

This work describes an outlier detection procedure (named "OutlierTree") loosely based on the GritBot software developed by RuleQuest research, which works by evaluating and following supervised decision tree splits on variables, in whose…

Machine Learning · Statistics 2020-01-06 David Cortes

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

The accuracy of machine learning interatomic potentials suffers from reference data that contains numerical noise. Often originating from unconverged or inconsistent electronic-structure calculations, this noise is challenging to identify.…

Machine Learning · Statistics 2026-02-10 Terry C. W. Lam , Niamh O'Neill , Christoph Schran , Lars L. Schaaf

The detection of outliers is of critical importance in the assurance of data quality. Outliers may exist in observed data or in data derived from these observed data, such as estimates and forecasts. An outlier may indicate a problem with…

Methodology · Statistics 2025-10-23 Charles D. Coleman , Thomas Bryan

Anomalies in economic and financial data -- often linked to rare yet impactful events -- are of theoretical interest, but can also severely distort inference. Although outlier-robust methodologies can be used, many researchers prefer…

Methodology · Statistics 2025-09-01 Monica Billio , Roberto Casarin , Fausto Corradin , Antonio Peruzzi

A multivariate dataset consists of $n$ cases in $d$ dimensions, and is often stored in an $n$ by $d$ data matrix. It is well-known that real data may contain outliers. Depending on the situation, outliers may be (a) undesirable errors which…

Methodology · Statistics 2019-10-08 Peter J. Rousseeuw , Wannes Van den Bossche

Universal outlier hypothesis testing is studied in a sequential setting. Multiple observation sequences are collected, a small subset of which are outliers. A sequence is considered an outlier if the observations in that sequence are…

Statistics Theory · Mathematics 2014-11-27 Yun Li , Sirin Nitinawarat , Venugopal V. Veeravalli

The neighbor-based method has become a powerful tool to handle the outlier detection problem, which aims to infer the abnormal degree of the sample based on the compactness of the sample and its neighbors. However, the existing methods…

Machine Learning · Computer Science 2024-05-30 Zhuang Qi , Junlin Zhang , Xiaming Chen , Xin Qi

In statistics and machine learning, the traditional meaning of the terms `outlier' and `anomaly' is a case in the dataset that behaves differently from the bulk of the data. This raises suspicion that it may belong to a different…

Methodology · Statistics 2026-04-17 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw

Matrix-variate distributions are a recent addition to the model-based clustering field, thereby making it possible to analyze data in matrix form with complex structure such as images and time series. Due to its recent appearance, there is…

Machine Learning · Statistics 2025-08-04 Katharine M. Clark , Paul D. McNicholas

Disease control experts inspect public health data streams daily for outliers worth investigating, like those corresponding to data quality issues or disease outbreaks. However, they can only examine a few of the thousands of maximally-tied…

Artificial Intelligence · Computer Science 2024-01-04 Ananya Joshi , Tina Townes , Nolan Gormley , Luke Neureiter , Roni Rosenfeld , Bryan Wilder

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. In [38], the problem of outlier detection in categorical data is defined as an optimization problem and…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

Observations in data which are significantly different from its neighbouring points but cannot be classified as noise are known as anomalies or outliers. These anomalies are a cause of concern and a timely warning about their presence could…

Applications · Statistics 2020-06-09 Krishnam Kapoor