English
Related papers

Related papers: The Impossibility Region for Detecting Sparse Mixt…

200 papers

We consider a data-driven robust hypothesis test where the optimal test will minimize the worst-case performance regarding distributions that are close to the empirical distributions with respect to the Wasserstein distance. This leads to a…

Statistics Theory · Mathematics 2021-06-01 Liyan Xie , Rui Gao , Yao Xie

Higher criticism is a method for detecting signals that are both sparse and weak. Although first proposed in cases where the noise variables are independent, higher criticism also has reasonable performance in settings where those variables…

Statistics Theory · Mathematics 2010-10-05 Peter Hall , Jiashun Jin

A central problem in Binary Hypothesis Testing (BHT) is to determine the optimal tradeoff between the Type I error (referred to as false alarm) and Type II (referred to as miss) error. In this context, the exponential rate of convergence of…

Information Theory · Computer Science 2021-11-29 Sebastian Espinosa , Jorge F. Silva , Pablo Piantanida

This paper proposes a max-test for testing (possibly infinitely) many zero parameter restrictions in an extremum estimation framework. The test statistic is formed by estimating key parameters one at a time based on many empirical loss…

Statistics Theory · Mathematics 2022-04-12 Jonathan B. Hill

The asymptotic distribution of the score test of the null hypothesis that marks do not impact the intensity of a Hawkes marked self-exciting point process is shown to be chi-squared. For local asymptotic power, the distribution against…

Statistics Theory · Mathematics 2019-05-01 Simon Clinet , William T. M. Dunsmuir , Gareth W. Peters , Kylie-Anne Richards

We examine weak measurements of arbitrary observables where the object is prepared in a mixed state and on which measurements with imperfect detectors are made. The weak value of an observable can be expressed as a conditional expectation…

Quantum Physics · Physics 2009-11-10 Lars M. Johansen , Alfredo Luis

High-dimensional statistical inference with general estimating equations are challenging and remain less explored. In this paper, we study two problems in the area: confidence set estimation for multiple components of the model parameters,…

Methodology · Statistics 2021-04-28 Jinyuan Chang , Song Xi Chen , Cheng Yong Tang , Tong Tong Wu

Despite its importance to experimental design, statistical power (the probability that, given a real effect, an experiment will reject the null hypothesis) has largely been ignored by the NLP community. Underpowered experiments make it more…

Computation and Language · Computer Science 2020-10-15 Dallas Card , Peter Henderson , Urvashi Khandelwal , Robin Jia , Kyle Mahowald , Dan Jurafsky

The analysis of large-scale datasets, especially in biomedical contexts, frequently involves a principled screening of multiple hypotheses. The celebrated two-group model jointly models the distribution of the test statistics with mixtures…

Methodology · Statistics 2023-03-10 Francesco Denti , Stefano Peluso , Michele Guindani , Antonietta Mira

A fundamental problem in high-dimensional testing is that of global null testing: testing whether the null holds simultaneously in all of $n$ hypotheses. The max test, which uses the smallest of the $n$ marginal p-values as its test…

Statistics Theory · Mathematics 2020-06-24 Xiao Li , William Fithian

We consider two alternative tests to the Higher Criticism test of Donoho and Jin [Ann. Statist. 32 (2004) 962-994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise…

Statistics Theory · Mathematics 2013-12-19 Ping-Shou Zhong , Song Xi Chen , Minya Xu

Testing independence is of significant interest in many important areas of large-scale inference. Using extreme-value form statistics to test against sparse alternatives and using quadratic form statistics to test against dense alternatives…

Statistics Theory · Mathematics 2015-12-31 Danning Li , Lingzhou Xue

We study asymptotically normal estimation and confidence regions for low-dimensional parameters in high-dimensional sparse models. Our approach is based on the $\ell_1$-penalized M-estimator which is used for construction of a bias…

Methodology · Statistics 2016-10-06 Jana Janková , Sara van de Geer

This paper develops a novel methodology for testing the goodness-of-fit of sparse parametric regression models based on projected empirical processes and p-value combination, where the covariate dimension may substantially exceed the sample…

Statistics Theory · Mathematics 2026-01-05 Falong Tan , Shan Tang , Lixing Zhu

The asymptotically optimal hypothesis testing problem with the general sources as the null and alternative hypotheses is studied under exponential-type error constraints on the first kind of error probability. Our fundamental philosophy in…

Probability · Mathematics 2007-05-23 Te Sun Han

We consider the problem of estimating the number of false null hypotheses among a very large number of independently tested hypotheses, focusing on the situation in which the proportion of false null hypotheses is very small. We propose a…

Statistics Theory · Mathematics 2007-06-13 Nicolai Meinshausen , John Rice

Consider a random vector $(X,Y)$ and let $m(x)=E(Y|X=x)$. We are interested in testing $H_0:m\in {\cal M}_{\Theta,{\cal G}}=\{\gamma(\cdot,\theta,g):\theta \in \Theta,g\in {\cal G}\}$ for some known function $\gamma$, some compact set…

Statistics Theory · Mathematics 2008-07-16 Ingrid Van Keilegom , César Sánchez Sellero , Wenceslao González Manteiga

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

In this paper, we propose a novel approach to detect heteroskedasticity in regression models with regressors contaminated by measurement error. Specifically, inspired by the integrated conditional moment (ICM) approach, we construct test…

Econometrics · Economics 2026-05-20 Xiaojun Song , Jichao Yuan

We propose a general method for constructing confidence intervals and statistical tests for single or low-dimensional components of a large parameter vector in a high-dimensional model. It can be easily adjusted for multiplicity taking…

Statistics Theory · Mathematics 2014-06-24 Sara van de Geer , Peter Bühlmann , Ya'acov Ritov , Ruben Dezeure