English
Related papers

Related papers: Outlier Detection in High Dimensional Data

200 papers

Outlier detection is one of the most important processes taken to create good, reliable data in machine learning. The most methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ning Huyan , Dou Quan , Xiangrong Zhang , Xuefeng Liang , Jocelyn Chanussot , Licheng Jiao

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

Detecting outliers which are grossly different from or inconsistent with the remaining dataset is a major challenge in real-world KDD applications. Existing outlier detection methods are ineffective on scattered real-world datasets due to…

Machine Learning · Computer Science 2009-12-30 Ke Zhang , Marcus Hutter , Huidong Jin

We study two problems in high-dimensional robust statistics: \emph{robust mean estimation} and \emph{outlier detection}. In robust mean estimation the goal is to estimate the mean $\mu$ of a distribution on $\mathbb{R}^d$ given $n$…

Data Structures and Algorithms · Computer Science 2019-06-28 Yihe Dong , Samuel B. Hopkins , Jerry Li

We present different methods of unsupervised learning which can be used for outlier detection in high energy nuclear collisions. The UrQMD model is used to generate the bulk background of events as well as different variants of outlier…

High Energy Physics - Experiment · Physics 2021-05-26 Punnathat Thaprasop , Kai Zhou , Jan Steinheimer , Christoph Herold

This paper considers the real-time detection of anomalies in high-dimensional systems. The goal is to detect anomalies quickly and accurately so that the appropriate countermeasures could be taken in time, before the system possibly gets…

Machine Learning · Computer Science 2020-07-16 Mahsa Mozaffari , Yasin Yilmaz

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy.…

Machine Learning · Computer Science 2020-09-22 Egor Klevak , Sangdi Lin , Andy Martin , Ondrej Linda , Eric Ringger

Various technologies, including computer vision models, are employed for the automatic monitoring of manual assembly processes in production. These models detect and classify events such as the presence of components in an assembly area or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Anton Sergeev , Victor Minchenkov , Aleksei Soldatov , Vasiliy Kakurin , Yaroslav Mazikov

Wireless sensor networks usually comprise a large number of sensors monitoring changes in variables. These changes in variables represent changes in physical quantities. The changes can occur for various reasons; these reasons are…

Machine Learning · Computer Science 2017-08-29 Pelumi Oluwasanya

Outlier Detection is a critical and cardinal research task due its array of applications in variety of domains ranging from data mining, clustering, statistical analysis, fraud detection, network intrusion detection and diagnosis of…

Machine Learning · Computer Science 2018-03-15 Archit Harsh , John E. Ball , Pan Wei

Recent advances in technology have brought major breakthroughs in data collection, enabling a large amount of data to be gathered over time and thus generating time series. Mining this data has become an important task for researchers and…

Machine Learning · Computer Science 2020-02-12 Ane Blázquez-García , Angel Conde , Usue Mori , Jose A. Lozano

Object detection is a pivotal task in computer vision that has received significant attention in previous years. Nonetheless, the capability of a detector to localise objects out of the training distribution remains unexplored. Whilst…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Brian K. S. Isaac-Medina , Yona Falinie A. Gaus , Neelanjan Bhowmik , Toby P. Breckon

Outlier detection and novelty detection are two important topics for anomaly detection. Suppose the majority of a dataset are drawn from a certain distribution, outlier detection and novelty detection both aim to detect data samples that do…

Machine Learning · Computer Science 2019-11-19 Min Du , Ruoxi Jia , Dawn Song

Anomaly detection suffers from unbalanced data since anomalies are quite rare. Synthetically generated anomalies are a solution to such ill or not fully defined data. However, synthesis requires an expressive representation to guarantee the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Adín Ramírez Rivera , Adil Khan , Imad E. I. Bekkouch , Taimoor S. Sheikh

The Dark Energy Survey is able to collect image data of an extremely large number of extragalactic objects, and it can be reasonably assumed that many unusual objects of high scientific interest are hidden inside these data. Due to the…

Astrophysics of Galaxies · Physics 2023-05-04 Lior Shamir

Anomalies (unusual patterns) in time-series data give essential, and often actionable information in critical situations. Examples can be found in such fields as healthcare, intrusion detection, finance, security and flight safety. In this…

Applications · Statistics 2016-08-17 Evgeny Burnaev , Vladislav Ishimtsev

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

Outlier detection is a major topic in robust statistics due to the high practical significance of anomalous observations. Many existing methods are, however, either parametric or cease to perform well when the data is far from linearly…

Methodology · Statistics 2018-11-14 Matias Heikkilä

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko