English
Related papers

Related papers: Distribution-Free Rates in Neyman-Pearson Classifi…

200 papers

We consider the problem of detecting sparse heterogeneous mixtures from a nonparametric perspective, and develop distribution-free tests when all effects have the same sign. Specifically, we assume that the null distribution is symmetric…

Statistics Theory · Mathematics 2013-11-18 Ery Arias-Castro , Meng Wang

We consider the following conditional linear regression problem: the task is to identify both (i) a $k$-DNF condition $c$ and (ii) a linear rule $f$ such that the probability of $c$ is (approximately) at least some given bound $\mu$, and…

Machine Learning · Computer Science 2018-06-28 John Hainline , Brendan Juba , Hai S. Le , David Woodruff

We consider the problem of determining which classes of functions can be tested more efficiently than they can be learned, in the distribution-free sample-based model that corresponds to the standard PAC learning setting. Our main result…

Machine Learning · Computer Science 2020-12-08 Eric Blais , Renato Ferreira Pinto , Nathaniel Harms

We study the problem of hypothesis testing between two discrete distributions, where we only have access to samples after the action of a known reversible Markov chain, playing the role of noise. We derive instance-dependent minimax rates…

Statistics Theory · Mathematics 2018-08-15 Quentin Berthet , Varun Kanade

We explore the problem of distributed Hypothesis Testing (DHT) against independence, focusing specifically on Binary Symmetric Sources (BSS). Our investigation aims to characterize the optimal quantizer among binary linear codes, with the…

Information Theory · Computer Science 2024-10-23 Fatemeh Khaledian , Reza Asvadi , Elsa Dupraz , Tad Matsumoto

Learning from a limited number of samples is challenging since the learned model can easily become overfitted based on the biased distribution formed by only a few training examples. In this paper, we calibrate the distribution of these…

Machine Learning · Computer Science 2021-08-17 Shuo Yang , Lu Liu , Min Xu

A Bayesian approach to the classification problem is proposed in which random partitions play a central role. It is argued that the partitioning approach has the capacity to take advantage of a variety of large-scale spatial structures, if…

Statistics Theory · Mathematics 2007-06-13 Marc A. Coram

In this paper, we propose a general framework for distribution-free nonparametric testing in multi-dimensions, based on a notion of multivariate ranks defined using the theory of measure transportation. Unlike other existing proposals in…

Statistics Theory · Mathematics 2019-10-08 Nabarun Deb , Bodhisattva Sen

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

Histogram-valued variables are a particular kind of variables studied in Symbolic Data Analysis where to each entity under analysis corresponds a distribution that may be represented by a histogram or by a quantile function. Linear…

Methodology · Statistics 2013-03-26 Sónia Dias , Paula Brito

Class imbalance is one of the challenging problems for machine learning in many real-world applications, such as coal and gas burst accident monitoring: the burst premonition data is extreme smaller than the normal data, however, which is…

Machine Learning · Computer Science 2017-02-07 Qiuyan Yan , Shixiong Xia , Fanrong Meng

Huge amount of applications in various fields, such as gene expression analysis or computer vision, undergo data sets with high-dimensional low-sample-size (HDLSS), which has putted forward great challenges for standard statistical and…

Machine Learning · Computer Science 2022-06-07 Liran Shen , Meng Joo Er , Qingbo Yin

We address the noncommutative version of the Edmonds' problem, which asks to determine the inner rank of a matrix in noncommuting variables. We provide an algorithm for the calculation of this inner rank by relating the problem with the…

Operator Algebras · Mathematics 2024-12-10 Johannes Hoffmann , Tobias Mai , Roland Speicher

We consider a Neyman-Pearson (NP) distributed binary detection problem in a bandwidth constrained wireless sensor network, where the fusion center (FC) is responsible for fusing signals received from sensors and making a final decision…

Signal Processing · Electrical Eng. & Systems 2019-06-18 Nahal Maleki , Azadeh Vosoughi

Let $X, Y$ be two independent identically distributed (i.i.d.) random variables taking values from a separable Banach space $(\mathcal{X}, \|\cdot\|)$. Given two measurable subsets $F, K\subseteq\cal{X}$, we established distribution free…

Probability · Mathematics 2018-05-01 Zhao Dong , Jiange Li , Wenbo V. Li

In this paper, a general class of regularized $M$-estimators of scatter matrix are proposed which are suitable also for low or insufficient sample support (small $n$ and large $p$) problems. The considered class constitutes a natural…

Applications · Statistics 2015-06-19 Esa Ollila , David E. Tyler

This paper presents a new method for conditional probability density simulation. The method is design to work with unstructured data set when data are not characterized by the same covariates yet share common information. Specific examples…

Methodology · Statistics 2025-08-05 Esteban G. Tabak , Giulio Trigila , Wenjun Zhao

In this paper, we are concerned with obtaining distribution-free concentration inequalities for mixture of independent Bernoulli variables that incorporate a notion of variance. Missing mass is the total probability mass associated to the…

Machine Learning · Statistics 2015-03-05 Bahman Yari Saeed Khanloo

Fair classification and fair representation learning are two important problems in supervised and unsupervised fair machine learning, respectively. Fair classification asks for a classifier that maximizes accuracy on a given data…

Machine Learning · Computer Science 2024-10-08 Sushant Agarwal , Amit Deshpande

We study the problem of offline changepoint localization in a distribution-free setting. One observes a vector of data with a single changepoint, assuming that the data before and after the changepoint are iid (or more generally…

Methodology · Statistics 2026-02-10 Rohan Hore , Aaditya Ramdas