English
Related papers

Related papers: Testing Outlier Detection Algorithms for Identifyi…

200 papers

The proliferation and variety of Internet of Things devices means that they have increasingly become a viable target for malicious users. This has created a need for anomaly detection algorithms that can work across multiple devices. This…

Cryptography and Security · Computer Science 2022-05-10 Lincoln Best , Ernest Foo , Hui Tian

There is a growing need to quickly and accurately identify anomalous behavior in ships. This paper applies a variation of the Density Based Spatial Clustering Among Noise (DBSCAN) algorithm to identify such anomalous behavior given a ship's…

Methodology · Statistics 2021-07-09 Carsten Botts

Clustering stands as one of the most prominent challenges in unsupervised machine learning. Among centroid-based methods, the classic $k$-means algorithm, based on Lloyd's heuristic, is widely used. Nonetheless, it is a well-known fact that…

Machine Learning · Statistics 2025-01-30 Supratik Basu , Jyotishka Ray Choudhury , Debolina Paul , Swagatam Das

Outlier detection (also known as anomaly detection or deviation detection) is a process of detecting data points in which their patterns deviate significantly from others. It is common to have outliers in industry applications, which could…

Machine Learning · Computer Science 2019-11-06 Kasra Babaei , ZhiYuan Chen , Tomas Maul

Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier detection may not…

Machine Learning · Computer Science 2020-03-10 Zhe Li , Chunhua Sun , Chunli Liu , Xiayu Chen , Meng Wang , Yezheng Liu

Clustering algorithms are fundamental tools across many fields, with density-based methods offering particular advantages in identifying arbitrarily shaped clusters and handling noise. However, their effectiveness is often limited by the…

Machine Learning · Computer Science 2025-12-01 Meysam Shirdel Bilehsavar , Razieh Ghaedi , Samira Seyed Taheri , Xinqi Fan , Christian O'Reilly

Recent advancements in neutron and X-ray sources, instrumentation and data collection modes have significantly increased the experimental data size (which could easily contain 10$^{8}$ -- 10$^{10}$ data points), so that conventional…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Yawei Hui , Yaohua Liu

HDBSCAN is a density-based clustering algorithm that constructs a cluster hierarchy tree and then uses a specific stability measure to extract flat clusters from the tree. We show how the application of an additional threshold value can…

Databases · Computer Science 2021-01-22 Claudia Malzer , Marcus Baum

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

Methodology · Statistics 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

We formulate the abnormal event detection problem as an outlier detection task and we propose a two-stage algorithm based on k-means clustering and one-class Support Vector Machines (SVM) to eliminate outliers. In the feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Radu Tudor Ionescu , Sorina Smeureanu , Marius Popescu , Bogdan Alexe

Among the many challenges posed by the huge data volumes produced by the new generation of astronomical instruments there is also the search for rare and peculiar objects. Unsupervised outlier detection algorithms may provide a viable…

Instrumentation and Methods for Astrophysics · Physics 2021-05-12 Lars Doorenbos , Stefano Cavuoti , Massimo Brescia , Antonio D'Isanto , Giuseppe Longo

Clustering is a cornerstone of modern data analysis. Detecting clusters in exploratory data analyses (EDA) requires algorithms that make few assumptions about the data. Density-based clustering algorithms are particularly well-suited for…

Machine Learning · Computer Science 2026-02-03 Daniël Bot , Leland McInnes , Jan Aerts

Traditional machine learning models focus on achieving good performance on the overall training distribution, but they often underperform on minority groups. Existing methods can improve the worst-group performance, but they can have…

Machine Learning · Computer Science 2022-10-14 Yuchen Zeng , Kristjan Greenewald , Kangwook Lee , Justin Solomon , Mikhail Yurochkin

In many situations where the interest lies in identifying clusters one might expect that not all available variables carry information about these groups. Furthermore, data quality (e.g. outliers or missing entries) might present a serious…

Machine Learning · Statistics 2012-01-31 Yumi Kondo , Matias Salibian-Barrera , Ruben Zamar

This paper introduces a novel family of outlier detection algorithms based on Cluster Catch Digraphs (CCDs), specifically tailored to address the challenges of high dimensionality and varying cluster shapes, which deteriorate the…

Machine Learning · Statistics 2024-10-10 Rui Shi , Nedret Billor , Elvan Ceyhan

In real world, our datasets often contain outliers. Moreover, the outliers can seriously affect the final machine learning result. Most existing algorithms for handling outliers take high time complexities (e.g. quadratic or cubic…

Computational Geometry · Computer Science 2020-02-28 Hu Ding , Zixiu Wang

We directly compare X-ray and optical techniques of cluster detection by combining SDSS photometric data with a wide-field ($\sim 1.8$ deg$^{2}$) XMM-{\em Newton} survey in the North Galactic Pole region. The optical cluster detection…

Outlier detection refers to the identification of anomalous samples that deviate significantly from the distribution of normal data and has been extensively studied and used in a variety of practical tasks. However, most unsupervised…

Machine Learning · Computer Science 2025-01-07 Can Gao , Xiaofeng Tan , Jie Zhou , Weiping Ding , Witold Pedrycz

DBSCAN is a classical density-based clustering procedure with tremendous practical relevance. However, DBSCAN implicitly needs to compute the empirical density for each sample point, leading to a quadratic worst-case time complexity, which…

Machine Learning · Computer Science 2019-05-21 Jennifer Jang , Heinrich Jiang

Existing methods for anomaly detection based on memory-augmented autoencoder (AE) have the following drawbacks: (1) Establishing a memory bank requires additional memory space. (2) The fixed number of prototypes from subjective assumptions…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Zhiwei Yang , Peng Wu , Jing Liu , Xiaotao Liu