English
Related papers

Related papers: Outlier detection and a tail-adjusted boxplot base…

200 papers

We establish a statistical learning theoretical framework aimed at extrapolation, or out-of-domain generalization, on the unobserved tails of covariates in continuous regression problems. Our strategy involves performing statistical…

Machine Learning · Statistics 2025-09-15 Stephan Clémençon , Nathan Huet , Anne Sabourin

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for…

Machine Learning · Statistics 2021-01-13 Peter J. Rousseeuw , Mia Hubert

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2017-11-15 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

The masses of data now available have opened up the prospect of discovering weak signals using machine-learning algorithms, with a view to predictive or interpretation tasks. As this survey of recent results attempts to show, bringing…

Statistics Theory · Mathematics 2026-05-06 Stephan Clémençon , Anne Sabourin

Outlier detection is an important problem occurring in a wide range of areas. Outliers are the outcome of fraudulent behaviour, mechanical faults, human error, or simply natural deviations. Many data mining applications perform outlier…

Machine Learning · Computer Science 2025-10-28 Juan A. Lara , David Lizcano , Víctor Rampérez , Javier Soriano

In 2017-2020 Jordanova and co-authors investigate probabilities for p-outside values and determine them in many particular cases. They show that these probabilities are closely related to the concept for heavy tails. Tukey's boxplots are…

Methodology · Statistics 2024-10-22 Pavlina K. Jordanova

An outlier is an observation or a data point that is far from rest of the data points in a given dataset or we can be said that an outlier is away from the center of mass of observations. Presence of outliers can skew statistical measures…

Machine Learning · Computer Science 2021-06-17 Amulya Agarwal , Nitin Gupta

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

Artificial Intelligence · Computer Science 2015-05-18 Charmgil Hong , Milos Hauskrecht

Tukey's boxplot is widely used for outlier detection; however, its classic fixed-fence rule tends to flag an excessive number of outliers as the sample size grows. To address this, we introduce two new R packages, ChauBoxplot and…

Methodology · Statistics 2026-03-04 Tiejun Tong , Hongmei Lin , Bowen Gang , Riquan Zhang

Explaining outliers occurrence and mechanism of their occurrence can be extremely important in a variety of domains. Malfunctions, frauds, threats, in addition to being correctly identified, oftentimes need a valid explanation in order to…

In this paper we consider the semi-parametric estimation of extreme quantiles of a right heavy-tail model. We propose a new Log Probability Weighted Moment estimator for extreme quantiles, which is obtained from the estimators of the shape…

Methodology · Statistics 2014-01-16 Frederico Caeiro , Dora Prata Gomes

This note investigates the problem of detecting outliers in longitudinal data. It compares well-known methods used in official statistics with proposals from the fields of data mining and machine learning that are based on the distance…

Methodology · Statistics 2025-07-30 Marcello D'Orazio

We propose a transformation capable of altering the tail properties of a distribution, motivated by extreme value theory, which can be used as a layer in a normalizing flow to approximate multivariate heavy tailed distributions. We apply…

Machine Learning · Statistics 2023-11-02 Tennessee Hickling , Dennis Prangle

Outliers are the points which are different from or inconsistent with the rest of the data. They can be novel, new, abnormal, unusual or noisy information. Outliers are sometimes more interesting than the majority of the data. The main…

Computer Vision and Pattern Recognition · Computer Science 2014-06-20 Singh Vijendra , Pathak Shivani

Causal questions are omnipresent in many scientific problems. While much progress has been made in the analysis of causal relationships between random variables, these methods are not well suited if the causal mechanisms only manifest…

Methodology · Statistics 2020-09-23 Nicola Gnecco , Nicolai Meinshausen , Jonas Peters , Sebastian Engelke

In this paper, we investigate the extreme-value methodology, to propose an improved estimator of the conditional tail expectation ($CTE$) for a loss distribution with a finite mean but infinite variance. The present work introduces a new…

Statistics Theory · Mathematics 2020-02-11 Mohamed Laidi , Abdelaziz Rassoul , Hamid Ould Rouis

Causal inference for extreme events has many potential applications in fields such as climate science, medicine and economics. We study the extremal quantile treatment effect of a binary treatment on a continuous, heavy-tailed outcome.…

Methodology · Statistics 2023-07-06 David Deuber , Jinzhou Li , Sebastian Engelke , Marloes H. Maathuis

Estimating the tail index parameter is one of the primal objectives in extreme value theory. For heavy-tailed distributions the Hill estimator is the most popular way to estimate the tail index parameter. Improving the Hill estimator was…

Methodology · Statistics 2018-06-05 László Németh , András Zempléni

The aim of the paper is to show that the presence of one possible type of outliers is not connected to that of heavy tails of the distribution. In contrary, typical situation for outliers appearance is the case of compact supported…

Statistics Theory · Mathematics 2018-07-25 Lev B. Klebanov , Irina Volchenkova