中文
相关论文

相关论文: Testing Outlier Detection Algorithms for Identifyi…

200 篇论文

The proliferation and variety of Internet of Things devices means that they have increasingly become a viable target for malicious users. This has created a need for anomaly detection algorithms that can work across multiple devices. This…

密码学与安全 · 计算机科学 2022-05-10 Lincoln Best , Ernest Foo , Hui Tian

There is a growing need to quickly and accurately identify anomalous behavior in ships. This paper applies a variation of the Density Based Spatial Clustering Among Noise (DBSCAN) algorithm to identify such anomalous behavior given a ship's…

统计方法学 · 统计学 2021-07-09 Carsten Botts

Clustering stands as one of the most prominent challenges in unsupervised machine learning. Among centroid-based methods, the classic $k$-means algorithm, based on Lloyd's heuristic, is widely used. Nonetheless, it is a well-known fact that…

机器学习 · 统计学 2025-01-30 Supratik Basu , Jyotishka Ray Choudhury , Debolina Paul , Swagatam Das

Outlier detection (also known as anomaly detection or deviation detection) is a process of detecting data points in which their patterns deviate significantly from others. It is common to have outliers in industry applications, which could…

机器学习 · 计算机科学 2019-11-06 Kasra Babaei , ZhiYuan Chen , Tomas Maul

Outlier detection is an important task in data mining and many technologies have been explored in various applications. However, due to the default assumption that outliers are non-concentrated, unsupervised outlier detection may not…

机器学习 · 计算机科学 2020-03-10 Zhe Li , Chunhua Sun , Chunli Liu , Xiayu Chen , Meng Wang , Yezheng Liu

Clustering algorithms are fundamental tools across many fields, with density-based methods offering particular advantages in identifying arbitrarily shaped clusters and handling noise. However, their effectiveness is often limited by the…

机器学习 · 计算机科学 2025-12-01 Meysam Shirdel Bilehsavar , Razieh Ghaedi , Samira Seyed Taheri , Xinqi Fan , Christian O'Reilly

Recent advancements in neutron and X-ray sources, instrumentation and data collection modes have significantly increased the experimental data size (which could easily contain 10$^{8}$ -- 10$^{10}$ data points), so that conventional…

计算机视觉与模式识别 · 计算机科学 2018-09-25 Yawei Hui , Yaohua Liu

HDBSCAN is a density-based clustering algorithm that constructs a cluster hierarchy tree and then uses a specific stability measure to extract flat clusters from the tree. We show how the application of an additional threshold value can…

数据库 · 计算机科学 2021-01-22 Claudia Malzer , Marcus Baum

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

统计方法学 · 统计学 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

We formulate the abnormal event detection problem as an outlier detection task and we propose a two-stage algorithm based on k-means clustering and one-class Support Vector Machines (SVM) to eliminate outliers. In the feature extraction…

计算机视觉与模式识别 · 计算机科学 2018-11-20 Radu Tudor Ionescu , Sorina Smeureanu , Marius Popescu , Bogdan Alexe

Among the many challenges posed by the huge data volumes produced by the new generation of astronomical instruments there is also the search for rare and peculiar objects. Unsupervised outlier detection algorithms may provide a viable…

天体物理仪器与方法 · 物理学 2021-05-12 Lars Doorenbos , Stefano Cavuoti , Massimo Brescia , Antonio D'Isanto , Giuseppe Longo

Clustering is a cornerstone of modern data analysis. Detecting clusters in exploratory data analyses (EDA) requires algorithms that make few assumptions about the data. Density-based clustering algorithms are particularly well-suited for…

机器学习 · 计算机科学 2026-02-03 Daniël Bot , Leland McInnes , Jan Aerts

Traditional machine learning models focus on achieving good performance on the overall training distribution, but they often underperform on minority groups. Existing methods can improve the worst-group performance, but they can have…

机器学习 · 计算机科学 2022-10-14 Yuchen Zeng , Kristjan Greenewald , Kangwook Lee , Justin Solomon , Mikhail Yurochkin

In many situations where the interest lies in identifying clusters one might expect that not all available variables carry information about these groups. Furthermore, data quality (e.g. outliers or missing entries) might present a serious…

机器学习 · 统计学 2012-01-31 Yumi Kondo , Matias Salibian-Barrera , Ruben Zamar

This paper introduces a novel family of outlier detection algorithms based on Cluster Catch Digraphs (CCDs), specifically tailored to address the challenges of high dimensionality and varying cluster shapes, which deteriorate the…

机器学习 · 统计学 2024-10-10 Rui Shi , Nedret Billor , Elvan Ceyhan

In real world, our datasets often contain outliers. Moreover, the outliers can seriously affect the final machine learning result. Most existing algorithms for handling outliers take high time complexities (e.g. quadratic or cubic…

计算几何 · 计算机科学 2020-02-28 Hu Ding , Zixiu Wang

We directly compare X-ray and optical techniques of cluster detection by combining SDSS photometric data with a wide-field ($\sim 1.8$ deg$^{2}$) XMM-{\em Newton} survey in the North Galactic Pole region. The optical cluster detection…

天体物理学 · 物理学 2009-11-10 S. Basilakos , M. Plionis , A. Georgakakis , I. Georgantopoulos , T. Gaga , V. Kolokotronis , G. C. Stewart

Outlier detection refers to the identification of anomalous samples that deviate significantly from the distribution of normal data and has been extensively studied and used in a variety of practical tasks. However, most unsupervised…

机器学习 · 计算机科学 2025-01-07 Can Gao , Xiaofeng Tan , Jie Zhou , Weiping Ding , Witold Pedrycz

DBSCAN is a classical density-based clustering procedure with tremendous practical relevance. However, DBSCAN implicitly needs to compute the empirical density for each sample point, leading to a quadratic worst-case time complexity, which…

机器学习 · 计算机科学 2019-05-21 Jennifer Jang , Heinrich Jiang

Existing methods for anomaly detection based on memory-augmented autoencoder (AE) have the following drawbacks: (1) Establishing a memory bank requires additional memory space. (2) The fixed number of prototypes from subjective assumptions…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Zhiwei Yang , Peng Wu , Jing Liu , Xiaotao Liu