English
Related papers

Related papers: Testing for Outliers with Conformal p-values

200 papers

In a network meta-analysis, some of the collected studies may deviate markedly from the others, for example having very unusual effect sizes. These deviating studies can be regarded as outlying with respect to the rest of the network and…

Methodology · Statistics 2023-01-11 Silvia Metelli , Dimitris Mavridis , Perrine Créquit , Anna Chaimani

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

Artificial Intelligence · Computer Science 2015-05-18 Charmgil Hong , Milos Hauskrecht

In the research on checking whether the underlying model is of parametric single-index structure with outliers in observations, the purpose of this paper is two-fold. First, a test that is robust against outliers is suggested. The Hampel's…

Methodology · Statistics 2015-10-13 Cuizhen Niu , Lixing Zhu

A novel method for sequential outlier detection in non-stationary time series is proposed. The method tests the null hypothesis of ``no outlier'' at each time point, addressing the multiple testing problem by bounding the error probability…

Statistics Theory · Mathematics 2025-02-26 Florian Heinrichs , Patrick Bastian , Holger Dette

Research on Out-Of-Distribution (OOD) detection focuses mainly on building scores that efficiently distinguish OOD data from In Distribution (ID) data. On the other hand, Conformal Prediction (CP) uses non-conformity scores to construct…

Machine Learning · Statistics 2024-03-19 Paul Novello , Joseba Dalmau , Léo Andeol

Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are…

Machine Learning · Computer Science 2019-08-01 Laure Berti-Equille , Ji Meng Loh , Saravanan Thirumuruganathan

We revisit outlier hypothesis testing, propose exponentially consistent low complexity fixed-length and sequential tests and show that our tests achieve better tradeoff between detection performance and computational complexity than…

Information Theory · Computer Science 2026-01-09 Jun Diao , Jingjing Wang , Lin Zhou

The purpose of this paper is to construct a new non-parametric detector of univariate outliers and to study its asymptotic properties. This detector is based on a Hill's type statistic. It satisfies a unique asymptotic behavior for a large…

Statistics Theory · Mathematics 2017-05-04 Jean-Marc Bardet , Solohaja-Faniaha Dimby

A skipped correlation has the advantage of dealing with outliers in a manner that takes into account the overall structure of the data cloud. For p-variate data, $p \ge 2$, there is an extant method for testing the hypothesis of a zero…

Computation · Statistics 2018-07-16 Rand Wilcox , Guillaume Rousselet , Cyril Pernet

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a…

Machine Learning · Statistics 2022-01-04 Zheng Li , Yue Zhao , Nicola Botta , Cezar Ionescu , Xiyang Hu

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is…

Machine Learning · Computer Science 2022-05-10 Penny Chong , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ new points, giving…

Methodology · Statistics 2024-03-20 Ulysse Gazin , Gilles Blanchard , Etienne Roquain

We theoretically analyze the problem of testing for $p$-hacking based on distributions of $p$-values across multiple studies. We provide general results for when such distributions have testable restrictions (are non-increasing) under the…

Econometrics · Economics 2022-05-13 Graham Elliott , Nikolay Kudrin , Kaspar Wuthrich

Most of existing outlier detection methods assume that the outlier factors (i.e., outlierness scoring measures) of data entities (e.g., feature values and data objects) are Independent and Identically Distributed (IID). This assumption does…

Machine Learning · Computer Science 2021-03-23 Guansong Pang , Longbing Cao , Ling Chen

In this paper we introduce a new method for detecting outliers in a set of proportions. It is based on the construction of a suitable two-way contingency table and on the application of an algorithm for the detection of outlying cells in…

Methodology · Statistics 2016-08-04 Flavio Mignone , Fabio Rapallo

The notion of p-value is a fundamental concept in statistical inference and has been widely used for reporting outcomes of hypothesis tests. However, p-value is often misinterpreted, misused or miscommunicated in practice. Part of the issue…

Methodology · Statistics 2020-02-03 Sifan Liu , Regina Liu , Min-ge Xie

We revisit sequential outlier hypothesis testing and derive bounds on achievable exponents when both the nominal and anomalous distributions are unknown. The task of outlier hypothesis testing is to identify the set of outliers that are…

Information Theory · Computer Science 2025-04-24 Jun Diao , Lin Zhou

Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Masoud Taghikhah , Nishant Kumar , Siniša Šegvić , Abouzar Eslami , Stefan Gumhold

We use p-values as a discrepancy criterion for identifying the threshold value at which a regression function takes off from its baseline value -- a problem that is motivated by applications in omics experiments, systems engineering,…

Methodology · Statistics 2010-08-26 Bodhisattva Sen , Moulinath Banerjee , George Michialidis

We examine the extent to which sublinear-sample property testing and estimation apply to settings where samples are independently but not identically distributed. Specifically, we consider the following distributional property testing…

Data Structures and Algorithms · Computer Science 2025-11-05 Shivam Garg , Chirag Pabbaraju , Kirankumar Shiragur , Gregory Valiant