English
Related papers

Related papers: ECOD: Unsupervised Outlier Detection Using Empiric…

200 papers

In this paper, we focus on the fairness issues regarding unsupervised outlier detection. Traditional algorithms, without a specific design for algorithmic fairness, could implicitly encode and propagate statistical bias in data and raise…

Machine Learning · Computer Science 2021-06-10 Hanyu Song , Peizhao Li , Hongfu Liu

Outlier detection aims to find samples that behave differently from the majority of the data. Semi-supervised detection methods can utilize the supervision of partial labels, thus reducing false positive rates. However, most of the current…

Machine Learning · Computer Science 2025-12-23 Baiyang Chen , Zhong Yuan , Dezhong Peng , Xiaoliang Chen , Hongmei Chen

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

Despite their successes, deep neural networks may make unreliable predictions when faced with test data drawn from a distribution different to that of the training data, constituting a major problem for AI safety. While this has recently…

Machine Learning · Computer Science 2020-07-16 Erik Daxberger , José Miguel Hernández-Lobato

Outlier detection is a crucial part of robust evaluation for crowdsourceable assessment of Quality of Experience (QoE) and has attracted much attention in recent years. In this paper, we propose some simple and fast algorithms for outlier…

Machine Learning · Statistics 2017-07-25 Qianqian Xu , Ming Yan , Chendi Huang , Jiechao Xiong , Qingming Huang , Yuan Yao

Normalization and outlier detection belong to the preprocessing of gene expression data. We propose a natural normalization procedure based on statistical data depth which normalizes to the distribution of gene expressions of the most…

Methodology · Statistics 2022-06-29 Alicia Nieto-Reyes , Javier Cabrera

Multi-dimensional scaling (MDS) plays a central role in data-exploration, dimensionality reduction and visualization. State-of-the-art MDS algorithms are not robust to outliers, yielding significant errors in the embedding even when only a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Leonid Blouvshtein , Daniel Cohen-Or

Unsupervised Outlier Detection (UOD) is a critical task in data mining and machine learning, aiming to identify instances that significantly deviate from the majority. Without any label, deep UOD methods struggle with the misalignment…

Machine Learning · Computer Science 2025-05-13 Yuang Zhang , Liping Wang , Yihong Huang , Yuanxing Zheng , Fan Zhang , Xuemin Lin

This study investigates the effectiveness of unsupervised outlier detection methods in audit analytics, utilizing USA spending data from the U.S. Department of Health and Human Services (DHHS) as a case example. We employ and compare…

Machine Learning · Computer Science 2025-09-25 Buhe Li , Berkay Kaplan , Maksym Lazirko , Aleksandr Kogan

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly…

Databases · Computer Science 2025-11-26 Mariana M Garcez Duarte , Mahmoud Sakr

Outlier explanation is the task of identifying a set of features that distinguish a sample from normal data, which is important for downstream (human) decision-making. Existing methods are based on beam search in the space of feature…

Machine Learning · Computer Science 2022-07-19 Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

There exist multiple methods to detect outliers in multivariate data in the literature, but most of them require to estimate the covariance matrix. The higher the dimension, the more complex the estimation of the matrix becoming impossible…

Methodology · Statistics 2020-12-01 P. Navarro-Esteban , J. A. Cuesta-Albertos

For real-world language applications, detecting an out-of-distribution (OOD) sample is helpful to alert users or reject such unreliable samples. However, modern over-parameterized language models often produce overconfident predictions for…

Computation and Language · Computer Science 2023-07-20 Jaeyoung Kim , Kyuheon Jung , Dongbin Na , Sion Jang , Eunbin Park , Sungchul Choi

Out-of-Distribution (OoD) detection has developed substantially in the past few years, with available methods approaching, and in a few cases achieving, perfect data separation on standard benchmarks. These results generally involve large…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Jarrod Haas

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Machine Learning · Computer Science 2024-10-31 Philipp Röchner , Henrique O. Marques , Ricardo J. G. B. Campello , Arthur Zimek , Franz Rothlauf

Extract, Transform, Load (ETL) is an integral part of Data Warehousing (DW) implementation. The commercial tools that are used for this purpose captures lot of execution trace in form of various log files with plethora of information.…

Databases · Computer Science 2012-03-09 Saptarsi Goswami , Samiran Ghosh , Amlan Chakrabarti

The nature of modern data is increasingly real-time, making outlier detection crucial in any data-related field, such as finance for fraud detection and healthcare for monitoring patient vitals. Traditional outlier detection methods, such…

Computation · Statistics 2025-01-03 Rui Hu , Luc , Chen , Yiwei Wang

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang