English
Related papers

Related papers: Improving Pearson's chi-squared test: hypothesis t…

200 papers

A hypothesis testing scheme for entanglement has been formulated based on the Poisson distribution framework instead of the POVM framework. Three designs were proposed to test the entangled states in this framework. The designs were…

Quantum Physics · Physics 2015-06-26 Masahito Hayashi , Akihisa Tomita , Keiji Matsumoto

We consider a stationary linear AR($p$) model with observations subject to gross errors (outliers). The autoregression parameters are unknown as well as the distribution function $G$ of innovations. The distribution of outliers $\Pi$ is…

Statistics Theory · Mathematics 2020-03-31 Michael Boldin

Chernoff information upper bounds the probability of error of the optimal Bayesian decision rule for $2$-class classification problems. However, it turns out that in practice the Chernoff bound is hard to calculate or even approximate. In…

Information Theory · Computer Science 2021-04-29 Frank Nielsen

The Chebyshev or $\ell_{\infty}$ estimator is an unconventional alternative to the ordinary least squares in solving linear regressions. It is defined as the minimizer of the $\ell_{\infty}$ objective function \begin{align*}…

Statistics Theory · Mathematics 2023-03-16 Yufei Yi , Matey Neykov

We develop a general method to quantify the uncertainties of parton distribution functions and their physical predictions, with emphasis on incorporating all relevant experimental constraints. The method uses the Hessian formalism to study…

High Energy Physics - Phenomenology · Physics 2008-12-18 J. Pumplin , D. Stump , R. Brock , D. Casey , J. Huston , J. Kalk , H. L. Lai , W. K. Tung

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

Hypothesis testing for small-sample scenarios is a practically important problem. In this paper, we investigate the robust hypothesis testing problem in a data-driven manner, where we seek the worst-case detector over distributional…

Machine Learning · Statistics 2022-05-17 Jie Wang , Yao Xie

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

The classical likelihood ratio test (LRT) based on the asymptotic chi-squared distribution of the log likelihood is one of the fundamental tools of statistical inference. A recent universal LRT approach based on sample splitting provides…

Methodology · Statistics 2022-11-22 Robin Dunn , Aaditya Ramdas , Sivaraman Balakrishnan , Larry Wasserman

We study the fundamental problems of (i) uniformity testing of a discrete distribution, and (ii) closeness testing between two discrete distributions with bounded $\ell_2$-norm. These problems have been extensively studied in distribution…

Data Structures and Algorithms · Computer Science 2016-11-14 Ilias Diakonikolas , Themis Gouleakis , John Peebles , Eric Price

In this paper we revisit the binary hypothesis testing problem with one-sided compression. Specifically we assume that the distribution in the null hypothesis is a mixture distribution of iid components. The distribution under the…

Information Theory · Computer Science 2022-07-07 Minh Thanh Vu

For estimating a positive normal mean, Zhang and Woodroofe (2003) as well as Roe and Woodroofe (2000) investigate 100($1-\alpha)%$ HPD credible sets associated with priors obtained as the truncation of noninformative priors onto the…

Statistics Theory · Mathematics 2016-08-16 Éric Marchand , William E. Strawderman

A Bayesian approach termed BAyesian Least Squares Optimization with Nonnegative L1-norm constraint (BALSON) is proposed. The error distribution of data fitting is described by Gaussian likelihood. The parameter distribution is assumed to be…

Machine Learning · Computer Science 2018-07-10 Jiyang Xie , Zhanyu Ma , Guoqiang Zhang , Jing-Hao Xue , Jen-Tzung Chien , Zhiqing Lin , Jun Guo

Consider the problem of binary hypothesis testing. Given $Z$ coming from either $\mathbb P^{\otimes m}$ or $\mathbb Q^{\otimes m}$, to decide between the two with small probability of error it is sufficient, and in many cases necessary, to…

Statistics Theory · Mathematics 2024-03-11 Patrik Róbert Gerber , Yury Polyanskiy

The classic chi-squared statistic for testing goodness-of-fit has long been a cornerstone of modern statistical practice. The statistic consists of a sum in which each summand involves division by the probability associated with the…

Computation · Statistics 2015-03-17 William Perkins , Mark Tygert , Rachel Ward

Under a multinormal distribution with an arbitrary unknown covariance matrix, the main purpose of this paper is to propose a framework to achieve the goal of reconciliation of Bayesian, frequentist, and Fisher's reporting $p$-values,…

Statistics Theory · Mathematics 2024-12-10 Ming-Tien Tsai

We study quantum algorithms for verifying properties of the output probability distribution of a classical or quantum circuit, given access to the source code that generates the distribution. We consider the basic task of uniformity…

Quantum Physics · Physics 2024-11-08 Clément L. Canonne , Robin Kothari , Ryan O'Donnell

For random samples of size n obtained from p-variate normal distributions, we consider the classical likelihood ratio tests (LRT) for their means and covariance matrices in the high-dimensional setting. These test statistics have been…

Statistics Theory · Mathematics 2013-06-04 Tiefeng Jiang , Fan Yang

A nonparametric anomalous hypothesis testing problem is investigated, in which there are totally n sequences with s anomalous sequences to be detected. Each typical sequence contains m independent and identically distributed (i.i.d.)…

Machine Learning · Computer Science 2016-12-15 Shaofeng Zou , Yingbin Liang , H. Vincent Poor , Xinghua Shi

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang