English
Related papers

Related papers: A robust multivariate, non-parametric outlier iden…

200 papers

A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic…

Statistics Theory · Mathematics 2015-10-28 David Morales-Jimenez , Romain Couillet , Matthew R. McKay

Three robust methods for clustering multivariate time series from the point of view of generating processes are proposed. The procedures are robust versions of a fuzzy C-means model based on: (i) estimates of the quantile cross-spectral…

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

Machine Learning · Computer Science 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

In this study, we propose a method Distributionally Robust Safe Screening (DRSS), for identifying unnecessary samples and features within a DR covariate shift setting. This method effectively combines DR learning, a paradigm aimed at…

Many complex vehicular systems, such as large marine vessels, contain confined spaces like water tanks, which are critical for the safe functioning of the vehicles. It is particularly hazardous for humans to inspect such spaces due to…

Robotics · Computer Science 2022-09-02 Benjamin Wong , Wade Marquette , Nikolay Bykov , Tyler M. Paine , Ashis G. Banerjee

Outlier or anomaly detection is an important task in data analysis. We discuss the problem from a geometrical perspective and provide a framework that exploits the metric structure of a data set. Our approach rests on the manifold…

Machine Learning · Statistics 2022-08-01 Moritz Herrmann , Florian Pfisterer , Fabian Scheipl

Fast radio bursts (FRBs) are mysterious astronomical phenomena, and it is still uncertain whether they consist of multiple types. In this study we use two nonlinear dimensionality reduction algorithms - Uniform Manifold Approximation and…

High Energy Astrophysical Phenomena · Physics 2023-05-17 X. Yang , S. -B. Zhang , J. -S. Wang , X. -F. Wu

Anomalies in economic and financial data -- often linked to rare yet impactful events -- are of theoretical interest, but can also severely distort inference. Although outlier-robust methodologies can be used, many researchers prefer…

Methodology · Statistics 2025-09-01 Monica Billio , Roberto Casarin , Fausto Corradin , Antonio Peruzzi

This article introduces trimmed estimators for the mean and covariance function of general functional data. The estimators are based on a new measure of outlyingness or data depth that is well defined on any metric space, although this…

Methodology · Statistics 2012-12-03 Daniel Gervini

This paper investigates calibration of sensor arrays in the radio astronomy context. Current and future radio telescopes require computationally efficient algorithms to overcome the new technical challenges as large collecting area, wide…

Applications · Statistics 2018-07-31 Virginie Ollier , Mohammed Nabil El Korso , André Ferrari , Rémy Boyer , Pascal Larzabal

For most hyperspectral remote sensing applications, removing bad bands, such as water absorption bands, is a required preprocessing step. Currently, the commonly applied method is by visual inspection, which is very time-consuming and it is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-20 Luyan Ji , Xiurui Geng , Yongchao Zhao , Fuxiang Wang

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

Machine Learning · Statistics 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

We propose a robust method for averaging numbers contaminated by a large proportion of outliers. Our method, dubbed RODIAN, is inspired by the key idea of MINPRAN [1]: We assume that the outliers are uniformly distributed within the range…

Methodology · Statistics 2022-11-22 Seong Hun Lee , Javier Civera

Fast Radio Bursts (FRBs) are millisecond-duration radio transients of extragalactic origin, exhibiting a wide range of physical and observational properties. Distinguishing between repeating and non-repeating FRBs remains a key challenge in…

We propose a new outlier detection method for multi-dimensional data. The method detects outliers based on vector cosine similarity, using a new dataset constructed by adding a dimension with zero values to the original data. When a point…

Machine Learning · Computer Science 2026-01-06 Zhongyang Shen

Euclidean embedding from noisy observations containing outlier errors is an important and challenging problem in statistics and machine learning. Many existing methods would struggle with outliers due to a lack of detection ability. In this…

Machine Learning · Statistics 2020-12-24 Qian Zhang , Xinyuan Zhao , Chao Ding

Wireless sensor networks usually comprise a large number of sensors monitoring changes in variables. These changes in variables represent changes in physical quantities. The changes can occur for various reasons; these reasons are…

Machine Learning · Computer Science 2017-08-29 Pelumi Oluwasanya

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

Machine Learning · Computer Science 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

Machine Learning · Computer Science 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

Machine Learning · Computer Science 2022-08-22 Mu Cai , Yixuan Li