English
Related papers

Related papers: Detecting Outliers in High-dimensional Data with M…

200 papers

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly…

Databases · Computer Science 2025-11-26 Mariana M Garcez Duarte , Mahmoud Sakr

Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are…

Machine Learning · Computer Science 2019-08-01 Laure Berti-Equille , Ji Meng Loh , Saravanan Thirumuruganathan

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

The detection of outliers is of critical importance in the assurance of data quality. Outliers may exist in observed data or in data derived from these observed data, such as estimates and forecasts. An outlier may indicate a problem with…

Methodology · Statistics 2025-10-23 Charles D. Coleman , Thomas Bryan

We present a nonparametric method for outlier detection that takes full account of local variations in intrinsic dimensionality within the dataset. Using the theory of Local Intrinsic Dimensionality (LID), our 'dimensionality-aware' outlier…

Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly…

Machine Learning · Computer Science 2021-11-17 Nishant Kumar , Pia Hanfeld , Michael Hecht , Michael Bussmann , Stefan Gumhold , Nico Hoffmann

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

The interactive exploration of large and evolving datasets is challenging as relationships between underlying variables may not be fully understood. There may be hidden trends and patterns in the data that are worthy of further exploration…

Machine Learning · Computer Science 2023-04-06 A. Ravishankar Rao , Daniel Clarke , Subrata Garai , Soumyabrata Dey

Many machine learning classification systems lack competency awareness. Specifically, many systems lack the ability to identify when outliers (e.g., samples that are distinct from and not represented in the training data distribution) are…

Machine Learning · Computer Science 2020-07-03 Matthew Cook , Alina Zare , Paul Gader

The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem…

Machine Learning · Computer Science 2013-06-18 Fabrizio Angiulli , Fabio Fassetti , Luigi Palopoli , Giuseppe Manco

Deep networks often make confident, yet, incorrect, predictions when tested with outlier data that is far removed from their training distributions. Likelihoods computed by deep generative models (DGMs) are a candidate metric for outlier…

Machine Learning · Computer Science 2022-07-20 Kushal Chauhan , Barath Mohan U , Pradeep Shenoy , Manish Gupta , Devarajan Sridharan

The development of effective knowledge discovery techniques has become in the recent few years a very active research area due to the important impact it has in several relevant application areas. One interesting task thereof is that of…

Artificial Intelligence · Computer Science 2007-05-23 Fabrizio Angiulli , Gianluigi Greco , Luigi Palopoli

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

Machine Learning · Computer Science 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

Methodology · Statistics 2017-07-12 Paul Fearnhead , Guillem Rigaill

Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier detection may not…

Machine Learning · Computer Science 2020-03-10 Zhe Li , Chunhua Sun , Chunli Liu , Xiayu Chen , Meng Wang , Yezheng Liu

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

Most of the existing methods for anomaly detection use only positive data to learn the data distribution, thus they usually need a pre-defined threshold at the detection stage to determine whether a test instance is an outlier.…

Machine Learning · Computer Science 2019-03-19 Kai Tian , Shuigeng Zhou , Jianping Fan , Jihong Guan

Datasets containing both categorical and continuous variables are frequently encountered in many areas, and with the rapid development of modern measurement technologies, the dimensions of these variables can be very high. Despite the…

Methodology · Statistics 2024-01-03 Binyan Jiang , Chenlei Leng , Cheng Wang , Zhongqing Yang , Xinyang Yu

Outlier is the term that indicates in statistics an anomalous observation, aberrant, clearly distant from others collected observations. The outliers are the subject to animated discussions in various contexts with regard to be or not to be…

Applications · Statistics 2014-03-24 Gianluca Rosso

This paper considers the problem of recovering signals modeled by generative models from linear measurements contaminated with sparse outliers. We propose an outlier detection approach for reconstructing the ground-truth signals modeled by…

Machine Learning · Statistics 2023-10-17 Jirong Yi , Jingchao Gao , Tianming Wang , Xiaodong Wu , Weiyu Xu