English
Related papers

Related papers: Outlier Detection in High Dimensional Data

200 papers

The nature of modern data is increasingly real-time, making outlier detection crucial in any data-related field, such as finance for fraud detection and healthcare for monitoring patient vitals. Traditional outlier detection methods, such…

Computation · Statistics 2025-01-03 Rui Hu , Luc , Chen , Yiwei Wang

Among the many challenges posed by the huge data volumes produced by the new generation of astronomical instruments there is also the search for rare and peculiar objects. Unsupervised outlier detection algorithms may provide a viable…

Instrumentation and Methods for Astrophysics · Physics 2021-05-12 Lars Doorenbos , Stefano Cavuoti , Massimo Brescia , Antonio D'Isanto , Giuseppe Longo

Unsupervised learning methods are well established in the area of anomaly detection and achieve state of the art performances on outlier datasets. Outliers play a significant role, since they bear the potential to distort the predictions of…

Machine Learning · Computer Science 2024-07-02 Andreas Lohrer , Daniyal Kazempour , Maximilian Hünemörder , Peer Kröger

Disease control experts inspect public health data streams daily for outliers worth investigating, like those corresponding to data quality issues or disease outbreaks. However, they can only examine a few of the thousands of maximally-tied…

Artificial Intelligence · Computer Science 2024-01-04 Ananya Joshi , Tina Townes , Nolan Gormley , Luke Neureiter , Roni Rosenfeld , Bryan Wilder

Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive data series often have common daily patterns that are repeated between similar days or seasons and shared among…

Methodology · Statistics 2022-10-10 A. Elías , J. M. Morales , S. Pineda

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse…

Data Structures and Algorithms · Computer Science 2019-11-20 Ilias Diakonikolas , Sushrut Karmalkar , Daniel Kane , Eric Price , Alistair Stewart

Hacking and false data injection from adversaries can threaten power grids' everyday operations and cause significant economic loss. Anomaly detection in power grids aims to detect and discriminate anomalies caused by cyber attacks against…

Machine Learning · Computer Science 2023-03-14 Xijuan Sun , Di Wu , Arnaud Zinflou , Benoit Boulet

Data depth is an efficient tool for robustly summarizing the distribution of functional data and detecting potential magnitude and shape outliers. Commonly used functional data depth notions, such as the modified band depth and extremal…

Methodology · Statistics 2023-11-07 Cristian F. Jimenez-Varon , Fouzi Harrou , Ying Sun

The development of effective knowledge discovery techniques has become in the recent few years a very active research area due to the important impact it has in several relevant application areas. One interesting task thereof is that of…

Artificial Intelligence · Computer Science 2007-05-23 Fabrizio Angiulli , Gianluigi Greco , Luigi Palopoli

Outlier detection is widely used in practice to track the anomaly on incremental datasets such as network traffic and system logs. However, these datasets often involve sensitive information, and sharing the data to third parties for…

Cryptography and Security · Computer Science 2019-11-15 Shangqi Lai , Xingliang Yuan , Amin Sakzad , Mahsa Salehi , Joseph K. Liu , Dongxi Liu

In real world, our datasets often contain outliers. Moreover, the outliers can seriously affect the final machine learning result. Most existing algorithms for handling outliers take high time complexities (e.g. quadratic or cubic…

Computational Geometry · Computer Science 2020-02-28 Hu Ding , Zixiu Wang

Many machine learning classification systems lack competency awareness. Specifically, many systems lack the ability to identify when outliers (e.g., samples that are distinct from and not represented in the training data distribution) are…

Machine Learning · Computer Science 2020-07-03 Matthew Cook , Alina Zare , Paul Gader

Machine learning and data analysis have been used in many robotics fields, especially for modelling. Data are usually the result of sensor measurements and, as such, they might be subjected to noise and outliers. The presence of outliers…

Robotics · Computer Science 2019-08-26 Francesco Cursi , Guang-Zhong Yang

Anomaly detection methods are part of the systems where rare events may endanger an operation's profitability, safety, and environmental aspects. Although many state-of-the-art anomaly detection methods were developed to date, their…

Machine Learning · Computer Science 2023-02-01 Marek Wadinger , Michal Kvasnica

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable…

High Energy Physics - Phenomenology · Physics 2024-03-06 Vinicius Mikuni , Benjamin Nachman

The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to separate the outliers…

Information Retrieval · Computer Science 2017-01-06 Ramakrishnan Kannan , Hyenkyun Woo , Charu C. Aggarwal , Haesun Park

We present a novel method for image anomaly detection, where algorithms that use samples drawn from some distribution of "normal" data, aim to detect out-of-distribution (abnormal) samples. Our approach includes a combination of encoder and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Nina Tuluptceva , Bart Bakker , Irina Fedulova , Anton Konushin

Most of existing outlier detection methods assume that the outlier factors (i.e., outlierness scoring measures) of data entities (e.g., feature values and data objects) are Independent and Identically Distributed (IID). This assumption does…

Machine Learning · Computer Science 2021-03-23 Guansong Pang , Longbing Cao , Ling Chen

In statistics and machine learning, the traditional meaning of the terms `outlier' and `anomaly' is a case in the dataset that behaves differently from the bulk of the data. This raises suspicion that it may belong to a different…

Methodology · Statistics 2026-04-17 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw

Random projection is a common technique for designing algorithms in a variety of areas, including information retrieval, compressive sensing and measuring of outlyingness. In this work, the original random projection outlyingness measure is…

Signal Processing · Electrical Eng. & Systems 2021-08-02 Martin Bauw , Santiago Velasco-Forero , Jesus Angulo , Claude Adnet , Olivier Airiau