English
Related papers

Related papers: Distribution-Free Rates in Neyman-Pearson Classifi…

200 papers

Multitask learning and related areas such as multi-source domain adaptation address modern settings where datasets from $N$ related distributions $\{P_t\}$ are to be combined towards improving performance on any single such distribution…

Machine Learning · Computer Science 2020-08-07 Steve Hanneke , Samory Kpotufe

We study the Neyman-Pearson problem for convex expectations on L^{\infty}(\mu). The existence of the optimal test is given. Without assuming that the level sets of penalty functions are weakly compact, we prove that the optimal tests for…

Probability · Mathematics 2019-12-11 Chuanfeng Sun , Shaolin Ji

We study a class of distributed hypothesis testing against conditional independence problems. Under the criterion that stipulates minimization of the Type II error rate subject to a (constant) upper bound $\epsilon$ on the Type I error…

Information Theory · Computer Science 2019-04-08 Abdellatif Zaidi , Inaki Estella Aguerri

The statistics and machine learning communities have recently seen a growing interest in classification-based approaches to two-sample testing. The outcome of a classification-based two-sample test remains a rejection decision, which is not…

Statistics Theory · Mathematics 2022-11-15 Loris Michel , Jeffrey Näf , Nicolai Meinshausen

We analyze a binary hypothesis testing problem built on a wireless sensor network (WSN) for detecting a stationary random process distributed both in space and time with circularly-symmetric complex Gaussian distribution under the…

Other Statistics · Statistics 2014-10-20 Juan Augusto Maya , Leonardo Rey Vega , Cecilia G. Galarza

This paper explores the theoretical foundations of fair regression under the constraint of demographic parity within the unawareness framework, where disparate treatment is prohibited, extending existing results where such treatment is…

Machine Learning · Statistics 2024-09-05 Vincent Divol , Solenne Gaucher

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

We consider the problem of estimating the mean of a distribution supported by the $k$-dimensional probability simplex in the setting where an $\varepsilon$ fraction of observations are subject to adversarial corruption. A simple particular…

Statistics Theory · Mathematics 2020-02-04 Amir-Hossein Bateni , Arnak S. Dalalyan

This paper is concerned with general nonlinear regression models where the predictor variables are subject to Berkson-type measurement errors. The measurement errors are assumed to have a general parametric distribution, which is not…

Statistics Theory · Mathematics 2009-08-21 Liqun Wang

The problem of zero-rate multiterminal hypothesis testing is revisited from the perspective of information-spectrum approach and finite blocklength analysis. A Neyman-Pearson-like test is proposed and its non-asymptotic performance is…

Information Theory · Computer Science 2017-08-17 Shun Watanabe

We consider high-dimensional quadratic classifiers in non-sparse settings. The target of classification rules is not Bayes error rates in the context. The classifier based on the Mahalanobis distance does not always give a preferable…

Machine Learning · Statistics 2015-08-24 Makoto Aoshima , Kazuyoshi Yata

In multiple classification, one aims to determine whether a testing sequence is generated from the same distribution as one of the M training sequences or not. Unlike most of existing studies that focus on discrete-valued sequences with…

Machine Learning · Statistics 2024-10-30 Lina Zhu , Lin Zhou

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

Statistics Theory · Mathematics 2019-06-10 T. Tony Cai , Hongji Wei

This paper studies multivariate nonparametric change point localization and inference problems. The data consists of a multivariate time series with potentially short range dependence. The distribution of this data is assumed to be…

Statistics Theory · Mathematics 2023-01-30 Carlos Misael Madrid Padilla , Haotian Xu , Daren Wang , Oscar Hernan Madrid Padilla , Yi Yu

Suppose $k$ centers are fit to $m$ points by heuristically minimizing the $k$-means cost; what is the corresponding fit over the source distribution? This question is resolved here for distributions with $p\geq 4$ bounded moments; in…

Machine Learning · Computer Science 2013-11-11 Matus Telgarsky , Sanjoy Dasgupta

This paper deals with rate distortion or source coding with fidelity criterion, in measure spaces, for a class of source distributions. The class of source distributions is described by a relative entropy constraint set between the true and…

Information Theory · Computer Science 2013-05-07 Farzad Rezaei , Charalambos D. Charalambous , Photios A. Stavrou

We point out that the Neyman-Pearson lemma applies to Bayes factors if we consider expected type-1 and type-2 error rates. That is, the Bayes factor is the test statistic that maximises the expected power for a fixed expected type-1 error…

Statistics Theory · Mathematics 2021-11-29 Andrew Fowlie

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy…

Machine Learning · Computer Science 2016-12-16 Travis Dick , Mu Li , Venkata Krishna Pillutla , Colin White , Maria Florina Balcan , Alex Smola

We study the multivariate nonparametric change point detection problem, where the data are a sequence of independent $p$-dimensional random vectors whose distributions are piecewise-constant with Lipschitz densities changing at unknown…

Statistics Theory · Mathematics 2020-06-26 Oscar Hernan Madrid Padilla , Yi Yu , Daren Wang , Alessandro Rinaldo

Distributional regression aims at estimating the conditional distribution of a targetvariable given explanatory co-variates. It is a crucial tool for forecasting whena precise uncertainty quantification is required. A popular methodology…

Statistics Theory · Mathematics 2024-11-22 Clément Dombry , Ahmed Zaoui