English
Related papers

Related papers: Asymptotics for Outlier Hypothesis Testing

200 papers

Bayesian statistics emphasizes the importance of prior distributions, yet finding an appropriate one is practically challenging. When multiple sample results are taken regarding the frequency of the same event, these samples may be…

Methodology · Statistics 2024-11-27 Yu-Fu Shen

In this paper we propose a Bayesian answer to testing problems when the hypotheses are not well separated. The idea of the method is to study the posterior distribution of a discrepancy measure between the parameter and the model we want to…

Statistics Theory · Mathematics 2017-06-28 Jean-Bernard Salomond

A central problem in Binary Hypothesis Testing (BHT) is to determine the optimal tradeoff between the Type I error (referred to as false alarm) and Type II (referred to as miss) error. In this context, the exponential rate of convergence of…

Information Theory · Computer Science 2021-11-29 Sebastian Espinosa , Jorge F. Silva , Pablo Piantanida

In this work, we revisit the one- and two-sample testing problems: binary hypothesis testing in which one or both distributions are unknown. For the one-sample test, we provide a more streamlined proof of the asymptotic optimality of…

Information Theory · Computer Science 2026-04-21 Arick Grootveld , Biao Chen , Venkata Gandikota

We study the problem of mismatched likelihood ratio test. We analyze the type-\RNum{1} and \RNum{2} error exponents when the actual distributions generating the observation are different from the distributions used in the test. We derive…

Information Theory · Computer Science 2020-01-14 Parham Boroumand , Albert Guillen i Fabregas

The composite binary hypothesis testing problem within the Neyman-Pearson framework is considered. The goal is to maximize the expectation of a nonlinear function of the detection probability, integrated with respect to a given probability…

Statistics Theory · Mathematics 2025-05-26 Yanglei Song , Berkan Dulek , Sinan Gezici

Consider a finite set of sources, each producing i.i.d. observations that follow a unique probability distribution on a finite alphabet. We study the problem of matching a finite set of observed sequences to the set of sources under the…

Information Theory · Computer Science 2014-12-09 Jayakrishnan Unnikrishnan

The purpose of this paper is to construct a new non-parametric detector of univariate outliers and to study its asymptotic properties. This detector is based on a Hill's type statistic. It satisfies a unique asymptotic behavior for a large…

Statistics Theory · Mathematics 2017-05-04 Jean-Marc Bardet , Solohaja-Faniaha Dimby

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater…

Neural and Evolutionary Computing · Computer Science 2018-10-04 Dan Hendrycks , Kevin Gimpel

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

The problem of universal outlying sequence detection is studied, where the goal is to detect outlying sequences among $M$ sequences of samples. A sequence is considered as outlying if the observations therein are generated by a distribution…

Information Theory · Computer Science 2020-05-27 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

Recent work has shown that deep generative models can assign higher likelihood to out-of-distribution data sets than to their training data (Nalisnick et al., 2019; Choi et al., 2019). We posit that this phenomenon is caused by a mismatch…

Machine Learning · Statistics 2019-10-17 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Balaji Lakshminarayanan

We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based…

Statistics Theory · Mathematics 2013-01-23 Georgios Fellouris , Alexander G. Tartakovsky

We study robust linear regression in high-dimension, when both the dimension $d$ and the number of data points $n$ diverge with a fixed ratio $\alpha=n/d$, and study a data model that includes outliers. We provide exact asymptotics for the…

Machine Learning · Statistics 2024-06-24 Matteo Vilucchio , Emanuele Troiani , Vittorio Erba , Florent Krzakala

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perform poorly as an…

Machine Learning · Computer Science 2023-04-28 Robert Schmier , Ullrich Köthe , Christoph-Nikolas Straehle

Outer measures can be used for statistical inference in place of probability measures to bring flexibility in terms of model specification. The corresponding statistical procedures such as Bayesian inference, estimators or hypothesis…

Statistics Theory · Mathematics 2020-05-05 Jeremie Houssineau , Neil K. Chada , Emmanuel Delande

This paper develops a flexible distribution-free method for collective outlier detection and enumeration, designed for situations in which the presence of outliers can be detected powerfully even though their precise identification may be…

Methodology · Statistics 2026-05-19 Chiara G. Magnani , Matteo Sesia , Aldo Solari

In epidemiological studies, very often, evaluators obtain measurements of disease outcomes for study participants. In this paper, we propose a two-stage procedure for detecting outlier evaluators. In the first stage, a regression model is…

Applications · Statistics 2022-09-28 Li Xu , Molin Wang

We propose thresholding as an approach to deal with class imbalance. We define the concept of thresholding as a process of determining a decision boundary in the presence of a tunable parameter. The threshold is the maximum value of this…

Machine Learning · Computer Science 2016-07-12 Charmgil Hong , Rumi Ghosh , Soundar Srinivasan