English
Related papers

Related papers: Cluster Purging: Efficient Outlier Detection based…

200 papers

Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world data is increasingly…

Machine Learning · Statistics 2016-08-18 Kien Do , Truyen Tran , Dinh Phung , Svetha Venkatesh

Current modularity-based community detection algorithms attempt to find cluster memberships that maximize modularity within a fixed graph topology. Diverging from this conventional approach, our work introduces a novel strategy that employs…

Data Analysis, Statistics and Probability · Physics 2024-02-27 Yongyu Wang , Shiqi Hao , Xiaoyang Wang , Xiaotian Zhuang

A computational theory for clustering and a semi-supervised clustering algorithm is presented. Clustering is defined to be the obtainment of groupings of data such that each group contains no anomalies with respect to a chosen grouping…

Machine Learning · Computer Science 2025-07-17 Nassir Mohammad

Clustering analysis is one of the critical tasks in machine learning. Traditionally, clustering has been an independent task, separate from outlier detection. Due to the fact that the performance of clustering can be significantly eroded by…

Machine Learning · Computer Science 2022-08-12 Jiahao Deng , Eli T. Brown

Outlier detection is a technique in data mining that aims to detect unusual or unexpected records in the dataset. Existing outlier detection algorithms have different pros and cons and exhibit different sensitivity to noisy data such as…

Machine Learning · Computer Science 2023-12-22 Yuanyuan Wei , Julian Jang-Jaccard , Fariza Sabrina , Timothy McIntosh

Functional data present unique challenges for clustering due to their infinite-dimensional nature and potential sensitivity to outliers. An extension of the OCLUST algorithm to the functional setting is proposed to address these issues. The…

Machine Learning · Statistics 2025-08-06 Katharine M. Clark , Paul D. McNicholas

In this paper, we present a local search-based algorithm for individually fair clustering in the presence of outliers. We consider the individual fairness definition proposed in Jung et al., which requires that each of the $n$ points in the…

Data Structures and Algorithms · Computer Science 2025-10-08 Binita Maity , Shrutimoy Das , Anirban Dasgupta

We propose a novel Bayesian optimisation procedure for outlier detection in the Capital Asset Pricing Model. We use a parametric product partition model to robustly estimate the systematic risk of an asset. We assume that the returns follow…

Applications · Statistics 2011-11-18 Maria Elena De Giuli , Mario Alessandro Maggi , Claudia Tarantola

In this paper we propose a graph-based data clustering algorithm which is based on exact clustering of a minimum spanning tree in terms of a minimum isoperimetry criteria. We show that our basic clustering algorithm runs in $O(n \log n)$…

Computer Vision and Pattern Recognition · Computer Science 2012-03-20 Amir Daneshgar , Ramin Javadi , Basir Shariat Razavi

Clustering is an unsupervised machine learning methodology where unlabeled elements/objects are grouped together aiming to the construction of well-established clusters that their elements are classified according to their similarity. The…

Machine Learning · Statistics 2023-10-20 Dimitrios Saligkaras , Vasileios E. Papageorgiou

Clustering is a fundamental task in data mining and machine learning, particularly for analyzing large-scale data. In this paper, we introduce Clust-Splitter, an efficient algorithm based on nonsmooth optimization, designed to solve the…

Machine Learning · Computer Science 2026-03-19 Jenni Lampainen , Kaisa Joki , Napsu Karmitsa , Marko M. Mäkelä

Over the decades, traditional outlier detectors have ignored the group-level factor when calculating outlier scores for objects in data by evaluating only the object-level factor, failing to capture the collective outliers. To mitigate this…

Machine Learning · Computer Science 2022-12-22 Jiawei Yang , Yu Chen , Sylwan Rahardja

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the…

Machine Learning · Computer Science 2023-09-04 Yu Wang , Lei Cao , Yizhou Yan , Samuel Madden

In an industrial context, the activity of sensors is recorded at a high frequency. A challenge is to automatically detect abnormal measurement behavior. Considering the sensor measures as functional data, the problem can be formulated as…

Statistics Theory · Mathematics 2022-03-09 Martial Amovin-Assagba , Irène Gannaz , Julien Jacques

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

Principal component analysis (PCA) is one of the most fundamental tools in machine learning with broad use as a dimensionality reduction and denoising tool. In the later setting, while PCA is known to be effective at subspace recovery and…

Machine Learning · Computer Science 2024-04-23 Chandra Sekhar Mukherjee , Nikhil Doerkar , Jiapeng Zhang

Clustering algorithms are one of the main analytical methods to detect patterns in unlabeled data. Existing clustering methods typically treat samples in a dataset as points in a metric space and compute distances to group together similar…

Machine Learning · Computer Science 2021-10-12 Tarek Naous , Srinjay Sarkar , Abubakar Abid , James Zou

In many applications, when building linear regression models, it is important to account for the presence of outliers, i.e., corrupted input data points. Such problems can be formulated as mixed-integer optimization problems involving cubic…

Optimization and Control · Mathematics 2023-07-13 Andrés Gómez , José Neto

A composite source, consisting of multiple subsources and a memoryless switch, outputs one symbol at a time from the subsource selected by the switch. If some data should be encoded more accurately than other data from an information…

Information Theory · Computer Science 2024-11-14 Jiakun Liu , H. Vincent Poor , Iickho Song , Wenyi Zhang

We develop a new density-based clustering algorithm named CRAD which is based on a new neighbor searching function with a robust data depth as the dissimilarity measure. Our experiments prove that the new CRAD is highly competitive at…

Computation · Statistics 2019-04-09 Xin Huang , Yulia R. Gel