English
Related papers

Related papers: Outlier Detection Using Vector Cosine Similarity b…

200 papers

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

Machine Learning · Computer Science 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

Rejecting outliers before applying classical robust methods is a common approach to increase the success rate of estimation, particularly when the outlier ratio is extremely high (e.g. 90%). However, this method often relies on sensor- or…

Robotics · Computer Science 2025-07-31 Jiayi Su , Shaofeng Zou , Jingyu Qian , Yan Wei , Fengzhong Qu , Liuqing Yang

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and…

Methodology · Statistics 2021-06-23 Luca Insolia , Francesca Chiaromonte , Runze Li , Marco Riani

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

This paper studies the outlier detection problem from the point of view of penalized regressions. Our regression model adds one mean shift parameter for each of the $n$ data points. We then apply a regularization favoring a sparse vector of…

Methodology · Statistics 2011-10-18 Yiyuan She , Art B. Owen

The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regarded as noise that…

Machine Learning · Computer Science 2014-05-25 M. H. Marghny , Ahmed I. Taloba

Detecting which nodes in graphs are outliers is a relatively new machine learning task with numerous applications. Despite the proliferation of algorithms developed in recent years for this task, there has been no standard comprehensive…

The detection of outliers is of critical importance in the assurance of data quality. Outliers may exist in observed data or in data derived from these observed data, such as estimates and forecasts. An outlier may indicate a problem with…

Methodology · Statistics 2025-10-23 Charles D. Coleman , Thomas Bryan

The product moment covariance is a cornerstone of multivariate data analysis, from which one can derive correlations, principal components, Mahalanobis distances and many other results. Unfortunately the product moment covariance and the…

Methodology · Statistics 2021-05-21 Jakob Raymaekers , Peter J. Rousseeuw

The recent, counter-intuitive discovery that deep generative models (DGMs) can frequently assign a higher likelihood to outliers has implications for both outlier detection applications as well as our overall understanding of generative…

Machine Learning · Statistics 2020-10-27 Ziyu Wang , Bin Dai , David Wipf , Jun Zhu

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

The minimum regularized covariance determinant method (MRCD) is a robust estimator for multivariate location and scatter, which detects outliers by fitting a robust covariance matrix to the data. Its regularization ensures that the…

Machine Learning · Statistics 2024-07-08 Joachim Schreurs , Iwein Vranckx , Mia Hubert , Johan A. K. Suykens , Peter J. Rousseeuw

In the present era of large scale surveys, big data presents new challenges to the discovery process for anomalous data. Such data can be indicative of systematic errors, extreme (or rare) forms of known phenomena, or most interestingly,…

Instrumentation and Methods for Astrophysics · Physics 2020-09-17 Daniel Giles , Lucianne Walkowicz

This paper studies the construction of p-values for nonparametric outlier detection, taking a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are…

Methodology · Statistics 2024-03-12 Stephen Bates , Emmanuel Candès , Lihua Lei , Yaniv Romano , Matteo Sesia

Outlier, or anomaly, detection is essential for optimal performance of machine learning methods and statistical predictive models. It is not just a technical step in a data cleaning process but a key topic in many fields such as fraudulent…

Machine Learning · Computer Science 2020-02-19 O. Ramos Terrades , A. Berenguel , D. Gil

The problem of outlier detection is extremely challenging in many domains such as text, in which the attribute values are typically non-negative, and most values are zero. In such cases, it often becomes difficult to separate the outliers…

Information Retrieval · Computer Science 2017-01-06 Ramakrishnan Kannan , Hyenkyun Woo , Charu C. Aggarwal , Haesun Park

The following detection problem is studied, in which there are $M$ sequences of samples out of which one outlier sequence needs to be detected. Each typical sequence contains $n$ independent and identically distributed (i.i.d.) continuous…

Information Theory · Computer Science 2015-10-08 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

Outlier detection is a core task in data mining with a plethora of algorithms that have enjoyed wide scale usage. Existing algorithms are primarily focused on detection, that is the identification of outliers in a given dataset. In this…

Machine Learning · Computer Science 2019-11-11 Yue Wu , Leman Akoglu , Ian Davidson

The curse of outlier measurements in estimation problems is a well known issue in a variety of fields. Therefore, outlier removal procedures, which enables the identification of spurious measurements within a set, have been developed for…

Information Theory · Computer Science 2017-08-02 Marco Compagnoni , Alessia Pini , Antonio Canclini , Paolo Bestagini , Fabio Antonacci , Stefano Tubaro , Augusto Sarti