English
Related papers

Related papers: Outlier Detection in High Dimensional Data

200 papers

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

Outlier detection is a technique in data mining that aims to detect unusual or unexpected records in the dataset. Existing outlier detection algorithms have different pros and cons and exhibit different sensitivity to noisy data such as…

Machine Learning · Computer Science 2023-12-22 Yuanyuan Wei , Julian Jang-Jaccard , Fariza Sabrina , Timothy McIntosh

It has become routine in neuroscience studies to measure brain networks for different individuals using neuroimaging. These networks are typically expressed as adjacency matrices, with each cell containing a summary of connectivity between…

Methodology · Statistics 2022-06-30 Pritam Dey , Zhengwu Zhang , David B. Dunson

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. In [38], the problem of outlier detection in categorical data is defined as an optimization problem and…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

The recent, counter-intuitive discovery that deep generative models (DGMs) can frequently assign a higher likelihood to outliers has implications for both outlier detection applications as well as our overall understanding of generative…

Machine Learning · Statistics 2020-10-27 Ziyu Wang , Bin Dai , David Wipf , Jun Zhu

One of the significant challenges in monitoring the quality of products today is the high dimensionality of quality characteristics. In this paper, we address Phase I analysis of high-dimensional processes with individual observations when…

Methodology · Statistics 2023-01-02 Mohsen Ebadi , Shojaeddin Chenouri , Stefan H. Steiner

The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem…

Machine Learning · Computer Science 2013-06-18 Fabrizio Angiulli , Fabio Fassetti , Luigi Palopoli , Giuseppe Manco

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

This note investigates the problem of detecting outliers in longitudinal data. It compares well-known methods used in official statistics with proposals from the fields of data mining and machine learning that are based on the distance…

Methodology · Statistics 2025-07-30 Marcello D'Orazio

With predictive models becoming prevalent, companies are expanding the types of data they gather. As a result, the collected datasets consist not only of simple numerical features but also more complex objects such as time series, images,…

Machine Learning · Computer Science 2025-07-01 Sebastian Chwilczyński , Dariusz Brzezinski

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and…

Methodology · Statistics 2021-06-23 Luca Insolia , Francesca Chiaromonte , Runze Li , Marco Riani

This paper considers the problem of outlier detection in functional data analysis focusing particularly on the more difficult case of shape outliers. We present an inductive conformal anomaly detection method based on elastic functional…

Methodology · Statistics 2025-04-11 Jason Adams , Brandon Berman , Joshua Michalenko , J. Derek Tucker

Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are…

Machine Learning · Computer Science 2019-08-01 Laure Berti-Equille , Ji Meng Loh , Saravanan Thirumuruganathan

Analyzing sequence data usually leads to the discovery of interesting patterns and then anomaly detection. In recent years, numerous frameworks and methods have been proposed to discover interesting patterns in sequence data as well as…

Databases · Computer Science 2021-12-01 Wensheng Gan , Lili Chen , Shicheng Wan , Jiahui Chen , Chien-Ming Chen

Outlier detection methods have become increasingly relevant in recent years due to increased security concerns and because of its vast application to different fields. Recently, Pauwels and Lasserre (2016) noticed that the sublevel sets of…

Machine Learning · Statistics 2018-06-19 Armin Askari , Forest Yang , Laurent El Ghaoui

In this paper we introduce a new method for detecting outliers in a set of proportions. It is based on the construction of a suitable two-way contingency table and on the application of an algorithm for the detection of outlying cells in…

Methodology · Statistics 2016-08-04 Flavio Mignone , Fabio Rapallo

Anomaly detection is referred to as a process in which the aim is to detect data points that follow a different pattern from the majority of data points. Anomaly detection methods suffer from several well-known challenges that hinder their…

Machine Learning · Computer Science 2021-08-31 Kasra Babaei , Zhi Yuan Chen , Tomas Maul

Outlier detection is the identification of points in a dataset that do not conform to the norm. Outlier detection is highly sensitive to the choice of the detection algorithm and the feature subspace used by the algorithm. Extracting…

Artificial Intelligence · Computer Science 2017-05-18 Yanjie Fu , Charu Aggarwal , Srinivasan Parthasarathy , Deepak S. Turaga , Hui Xiong

Outlier detection refers to the identification of anomalous samples that deviate significantly from the distribution of normal data and has been extensively studied and used in a variety of practical tasks. However, most unsupervised…

Machine Learning · Computer Science 2025-01-07 Can Gao , Xiaofeng Tan , Jie Zhou , Weiping Ding , Witold Pedrycz