English
Related papers

Related papers: Distribution-Free Rates in Neyman-Pearson Classifi…

200 papers

We consider the problem of transfer learning in Neyman-Pearson classification, where the objective is to minimize the error w.r.t. a distribution $\mu_1$, subject to the constraint that the error w.r.t. a distribution $\mu_0$ remains below…

Machine Learning · Computer Science 2025-11-11 Mohammadreza M. Kalan , Yuyang Deng , Eitan J. Neugut , Samory Kpotufe

Motivated by problems of anomaly detection, this paper implements the Neyman-Pearson paradigm to deal with asymmetric errors in binary classification with a convex loss. Given a finite collection of classifiers, we combine them and obtain a…

Machine Learning · Statistics 2011-03-01 Philippe Rigollet , Xin Tong

We propose a universal classifier for binary Neyman-Pearson classification where null distribution is known while only a training sequence is available for the alternative distribution. The proposed classifier interpolates between…

Information Theory · Computer Science 2022-06-24 Parham Boroumand , Albert Guillén i Fàbregas

Most existing binary classification methods target on the optimization of the overall classification risk and may fail to serve some real-world applications such as cancer diagnosis, where users are more concerned with the risk of…

Machine Learning · Statistics 2015-08-18 Anqi Zhao , Yang Feng , Lie Wang , Xin Tong

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

Despite the availability of numerous statistical and machine learning tools for joint feature modeling, many scientists investigate features marginally, i.e., one feature at a time. This is partly due to training and convention but also…

Methodology · Statistics 2021-12-01 Jingyi Jessica Li , Yiling Chen , Xin Tong

The Neyman-Pearson (NP) binary classification paradigm constrains the more severe type of error (e.g., the type I error) under a preferred level while minimizing the other (e.g., the type II error). This paradigm is suitable for…

Methodology · Statistics 2022-06-07 Jingming Wang , Lucy Xia , Zhigang Bao , Xin Tong

We study ``selective'' or ``conditional'' classification problems under an agnostic setting. Classification tasks commonly focus on modeling the relationship between features and categories that captures the vast majority of data. In…

Machine Learning · Computer Science 2025-02-04 Jizhou Huang , Brendan Juba

The Neyman-Pearson region of a simple binary hypothesis testing is the set of points whose coordinates represent the false positive rate and false negative rate of some test. The lower boundary of this region is given by the Neyman-Pearson…

Statistics Theory · Mathematics 2025-05-15 Andrew Mullhaupt , Cheng Peng

The task of the binary classification problem is to determine which of two distributions has generated a length-$n$ test sequence. The two distributions are unknown; two training sequences of length $N$, one from each distribution, are…

Information Theory · Computer Science 2016-04-18 Dayu Huang , Sean Meyn

Asymmetric binary classification problems, in which the type I and II errors have unequal severity, are ubiquitous in real-world applications. To handle such asymmetry, researchers have developed the cost-sensitive and Neyman-Pearson…

Machine Learning · Statistics 2021-01-01 Wei Vivian Li , Xin Tong , Jingyi Jessica Li

This paper studies minimax rates of convergence for nonparametric location-scale models, which include mean, quantile and expectile regression settings. Under Hellinger differentiability on the error distribution and other mild conditions,…

Statistics Theory · Mathematics 2023-07-06 Bingxin Zhao , Yuhong Yang

Selective classification enhances the reliability of predictive models by allowing them to abstain from making uncertain predictions. In this work, we revisit the design of optimal selection functions through the lens of the Neyman--Pearson…

Machine Learning · Computer Science 2026-03-04 Alvin Heng , Harold Soh

We propose a distribution-free approach to the study of random geometric graphs. The distribution of vertices follows a Poisson point process with intensity function $nf(\cdot)$, where $n\in \mathbb{N}$, and $f$ is a probability density…

Probability · Mathematics 2012-10-22 Srikanth K. Iyer , Debleena Thacker

`Distribution regression' refers to the situation where a response Y depends on a covariate P where P is a probability distribution. The model is Y=f(P) + mu where f is an unknown regression function and mu is a random error. Typically, we…

Machine Learning · Statistics 2013-02-04 Barnabas Poczos , Alessandro Rinaldo , Aarti Singh , Larry Wasserman

We study convergence rates of variational posterior distributions for nonparametric and high-dimensional inference. We formulate general conditions on prior, likelihood, and variational class that characterize the convergence rates. Under…

Statistics Theory · Mathematics 2019-06-18 Fengshuo Zhang , Chao Gao

We consider a multi-stage distributed detection scenario, where $n$ sensors and a fusion center (FC) are deployed to accomplish a binary hypothesis test. At each time stage, local sensors generate binary messages, assumed to be spatially…

Signal Processing · Electrical Eng. & Systems 2023-01-04 Guangyang Zeng , Xiaoqiang Ren , Junfeng Wu

Consider the problem of binary hypothesis testing. Given $Z$ coming from either $\mathbb P^{\otimes m}$ or $\mathbb Q^{\otimes m}$, to decide between the two with small probability of error it is sufficient, and in many cases necessary, to…

Statistics Theory · Mathematics 2024-03-11 Patrik Róbert Gerber , Yury Polyanskiy

For Machine Learning (ML) classification problem, where a vector of $\mathbf{x}$--observations (values of attributes) is mapped to a single $y$ value (class label), a generalized Radon--Nikodym type of solution is proposed.…

Machine Learning · Computer Science 2015-12-16 Vladislav Gennadievich Malyshkin

We here provide a distribution-free approach to the random factor analysis model. We show that it leads to the same estimating equations as for the classical ML estimates under normality, but more easily derived, and valid also in the case…

Statistics Theory · Mathematics 2013-12-31 Rolf Sundberg , Uwe Feldmann
‹ Prev 1 2 3 10 Next ›