English
Related papers

Related papers: Second-Order Asymptotically Optimal Outlier Hypoth…

200 papers

Consider a finite set of sources, each producing i.i.d. observations that follow a unique probability distribution on a finite alphabet. We study the problem of matching a finite set of observed sequences to the set of sources under the…

Information Theory · Computer Science 2014-12-09 Jayakrishnan Unnikrishnan

A critical barrier to learning an accurate decision rule for outlier detection is the scarcity of outlier data. As such, practitioners often turn to the use of similar but imperfect outlier data from which they might transfer information to…

Machine Learning · Computer Science 2023-10-10 Mohammadreza M. Kalan , Samory Kpotufe

Multiple testing problems are a staple of modern statistical analysis. The fundamental objective of multiple testing procedures is to reject as many false null hypotheses as possible (that is, maximize some notion of power), subject to…

Methodology · Statistics 2020-11-30 Saharon Rosset , Ruth Heller , Amichai Painsky , Ehud Aharoni

In two-sampling testing, one observes two independent sequences of independent and identically distributed random variables distributed according to the distributions $P_1$ and $P_2$ and wishes to decide whether $P_1=P_2$ (null hypothesis)…

Information Theory · Computer Science 2026-01-15 K V Harsha , Jithin Ravi , Tobias Koch

A new technique for the detection of outliers in contingency tables is introduced. Outliers thereby are unexpected cell counts with respect to classical loglinear Poisson models. Subsets of cell counts called minimal patterns are defined,…

Computation · Statistics 2012-11-15 Sonja Kuhnt , Fabio Rapallo , André Rehage

The asymptotically optimal hypothesis testing problem with the general sources as the null and alternative hypotheses is studied under exponential-type error constraints on the first kind of error probability. Our fundamental philosophy in…

Probability · Mathematics 2007-05-23 Te Sun Han

We study the problem of mismatched binary hypothesis testing between i.i.d. distributions. We analyze the tradeoff between the pairwise error probability exponents when the actual distributions generating the observation are different from…

Information Theory · Computer Science 2022-04-28 Parham Boroumand , Albert Guillén i Fàbregas

We study the change detection problem with an unknown post-change distribution. Under this constraint, the unknown change in the distribution of observations may occur in many ways without much structure on the observations, whereas, before…

Signal Processing · Electrical Eng. & Systems 2020-12-11 Deniz Sargun , C. Emre Koksal

We revisit $M$-ary classification of Gutman (TIT 1989), where one is tasked to determine whether a testing sequence is generated with the same distribution as one of the $M$ training sequences or not. Our main result is a two-phase test,…

Information Theory · Computer Science 2023-05-29 Lin Zhou , Jun Diao , Lin Bai

We introduce an online outlier detection algorithm to detect outliers in a sequentially observed data stream. For this purpose, we use a two-stage filtering and hedging approach. In the first stage, we construct a multi-modal probability…

Machine Learning · Computer Science 2018-03-13 Mohammadreza Mohaghegh Neyshabouri , Suleyman Serdar Kozat

In this paper we revisit the binary hypothesis testing problem with one-sided compression. Specifically we assume that the distribution in the null hypothesis is a mixture distribution of iid components. The distribution under the…

Information Theory · Computer Science 2022-07-07 Minh Thanh Vu

In multiple classification, one aims to determine whether a testing sequence is generated from the same distribution as one of the M training sequences or not. Unlike most of existing studies that focus on discrete-valued sequences with…

Machine Learning · Statistics 2024-10-30 Lina Zhu , Lin Zhou

A distributed binary hypothesis testing problem, in which multiple observers transmit their observations to a detector over noisy channels, is studied. Given its own side information, the goal of the detector is to decide between two…

Information Theory · Computer Science 2017-04-06 Sreejith Sreekumar , Deniz Gündüz

Selective classification enhances the reliability of predictive models by allowing them to abstain from making uncertain predictions. In this work, we revisit the design of optimal selection functions through the lens of the Neyman--Pearson…

Machine Learning · Computer Science 2026-03-04 Alvin Heng , Harold Soh

The following detection problem is studied, in which there are $M$ sequences of samples out of which one outlier sequence needs to be detected. Each typical sequence contains $n$ independent and identically distributed (i.i.d.) continuous…

Information Theory · Computer Science 2015-10-08 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

We consider the problem of transfer learning in outlier detection where target abnormal data is rare. While transfer learning has been considered extensively in traditional balanced classification, the problem of transfer in outlier…

Machine Learning · Computer Science 2025-01-06 Mohammadreza M. Kalan , Eitan J. Neugut , Samory Kpotufe

Finding the underlying probability distributions of a set of observed sequences under the constraint that each sequence is generated i.i.d by a distinct distribution is considered. The number of distributions, and hence the number of…

Information Theory · Computer Science 2018-10-16 Sara Shahi , Daniela Tuninetti , Natasha Devroye

Motivated by problems of anomaly detection, this paper implements the Neyman-Pearson paradigm to deal with asymmetric errors in binary classification with a convex loss. Given a finite collection of classifiers, we combine them and obtain a…

Machine Learning · Statistics 2011-03-01 Philippe Rigollet , Xin Tong

The first- and second-order optimum achievable exponents in the simple hypothesis testing problem are investigated. The optimum achievable exponent for type II error probability, under the constraint that the type I error probability is…

Information Theory · Computer Science 2018-04-04 Te Sun Han , Ryo Nomura

We study sequential multiple testing with independent data streams, where the goal is to identify an unknown subset of signals while controlling commonly used error metrics, including generalized familywise rates and false discovery and…

Statistics Theory · Mathematics 2026-03-06 Jingyu Liu , Yanglei Song