English
Related papers

Related papers: Comparison of Outlier Detection Techniques for Str…

200 papers

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

The task of outlier detection is to find small groups of data objects that are exceptional when compared with rest large amount of data. Detection of such outliers is important for many applications such as fraud detection and customer…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

Methodology · Statistics 2017-07-12 Paul Fearnhead , Guillem Rigaill

Many computer vision tasks involve processing large amounts of data contaminated by outliers, which need to be detected and rejected. While outlier detection methods based on robust statistics have existed for decades, only recently have…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Chong You , Daniel P. Robinson , René Vidal

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

Unsupervised outlier detection, which predicts if a test sample is an outlier or not using only the information from unlabelled inlier data, is an important but challenging task. Recently, methods based on the two-stage framework achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Zhisheng Xiao , Qing Yan , Yali Amit

Outlying observations are frequently encountered across a wide spectrum of scientific domains, posing notable challenges to the generalizability of statistical models and the reproducibility of downstream analysis. They are identified…

Methodology · Statistics 2026-03-17 Dongliang Zhang , Masoud Asgharian , Martin A. Lindquist

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

The accuracy of machine learning interatomic potentials suffers from reference data that contains numerical noise. Often originating from unconverged or inconsistent electronic-structure calculations, this noise is challenging to identify.…

Machine Learning · Statistics 2026-02-10 Terry C. W. Lam , Niamh O'Neill , Christoph Schran , Lars L. Schaaf

Outlier detection in data streams has gained wide importance presently due to the increasing cases of fraud in various applications of data streams. The techniques for outlier detection have been divided into either statistics based,…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-03-25 Parneeta Dhaliwal , M. P. S. Bhatia , Priti Bansal

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Disease control experts inspect public health data streams daily for outliers worth investigating, like those corresponding to data quality issues or disease outbreaks. However, they can only examine a few of the thousands of maximally-tied…

Artificial Intelligence · Computer Science 2024-01-04 Ananya Joshi , Tina Townes , Nolan Gormley , Luke Neureiter , Roni Rosenfeld , Bryan Wilder

Normalization and outlier detection belong to the preprocessing of gene expression data. We propose a natural normalization procedure based on statistical data depth which normalizes to the distribution of gene expressions of the most…

Methodology · Statistics 2022-06-29 Alicia Nieto-Reyes , Javier Cabrera

The neighbor-based method has become a powerful tool to handle the outlier detection problem, which aims to infer the abnormal degree of the sample based on the compactness of the sample and its neighbors. However, the existing methods…

Machine Learning · Computer Science 2024-05-30 Zhuang Qi , Junlin Zhang , Xiaming Chen , Xin Qi

The ability to collect and store ever more massive databases has been accompanied by the need to process them efficiently. In many cases, most observations have the same behavior, while a probable small proportion of these observations are…

Statistics Theory · Mathematics 2021-09-21 Myrto Limnios , Nathan Noiry , Stéphan Clémençon

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

Successful detection of Out-of-Distribution (OoD) data is becoming increasingly important to ensure safe deployment of neural networks. One of the main challenges in OoD detection is that neural networks output overconfident predictions on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sangha Park , Jisoo Mok , Dahuin Jung , Saehyung Lee , Sungroh Yoon

We propose two new outlier detection methods, for identifying and classifying different types of outliers in (big) functional data sets. The proposed methods are based on an existing method called Massive Unsupervised Outlier Detection…

Methodology · Statistics 2021-10-15 Oluwasegun Taiwo Ojo , Antonio Fernández Anta , Rosa E. Lillo , Carlo Sguera

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

Methodology · Statistics 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White