English
Related papers

Related papers: Detecting Sparse Heterogeneous Mixtures in a Two-S…

200 papers

The two-sample problem, which consists in testing whether independent samples on $\mathbb{R}^d$ are drawn from the same (unknown) distribution, finds applications in many areas. Its study in high-dimension is the subject of much attention,…

Statistics Theory · Mathematics 2023-02-09 Stephan Clémençon , Myrto Limnios , Nicolas Vayatis

We present a simple algorithm for identifying and correcting real-valued noisy labels from a mixture of clean and corrupted sample points using Gaussian process regression. A heteroscedastic noise model is employed, in which additive…

Machine Learning · Computer Science 2021-03-30 Yu-Hang Tang , Yuanran Zhu , Wibe A. de Jong

Nonparametric two-sample testing is a classical problem in inferential statistics. While modern two-sample tests, such as the edge count test and its variants, can handle multivariate and non-Euclidean data, contemporary gargantuan datasets…

Methodology · Statistics 2023-04-28 Trambak Banerjee , Bhaswar B. Bhattacharya , Gourab Mukherjee

A non parametric method based on the empirical likelihood is proposed for detecting the change in the coefficients of high-dimensional linear model where the number of model variables may increase as the sample size increases. This amounts…

Statistics Theory · Mathematics 2015-06-22 Gabriela Ciuperca , Zahraa Salloum

We study the rate of decay of the probability of error for distinguishing between a sparse signal with noise, modeled as a sparse mixture, from pure noise. This problem has many applications in signal processing, evolutionary biology,…

Information Theory · Computer Science 2016-12-28 Jonathan G. Ligo , George V. Moustakides , Venugopal V. Veeravalli

In this paper, we study the detection boundary for minimax hypothesis testing in the context of high-dimensional, sparse binary regression models. Motivated by genetic sequencing association studies for rare variant effects, we investigate…

Statistics Theory · Mathematics 2015-03-06 Rajarshi Mukherjee , Natesh S. Pillai , Xihong Lin

We introduce a new approach for comparing the predictive accuracy of two nested models that bypasses the difficulties caused by the degeneracy of the asymptotic variance of forecast error loss differentials used in the construction of…

Econometrics · Economics 2023-10-17 Jean-Yves Pitarakis

We discuss a general approach to handling "multiple hypotheses" testing in the case when a particular hypothesis states that the vector of parameters identifying the distribution of observations belongs to a convex compact set associated…

Statistics Theory · Mathematics 2016-02-24 A. Goldenshluger , A. Juditski , A. Nemirovski

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

Many scientific and engineering challenges -- ranging from pharmacokinetic drug dosage allocation and personalized medicine to marketing mix (4Ps) recommendations -- require an understanding of the unobserved heterogeneity in order to…

Methodology · Statistics 2017-08-17 Jelena Bradic , Gerda Claeskens , Thomas Gueuning

Motivated by the likelihood ratio test under the Gaussian assumption, we develop a maximum sum-of-squares test for conducting hypothesis testing on high dimensional mean vector. The proposed test which incorporates the dependence among the…

Methodology · Statistics 2015-10-21 Xianyang Zhang

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

We consider two alternative tests to the Higher Criticism test of Donoho and Jin [Ann. Statist. 32 (2004) 962-994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise…

Statistics Theory · Mathematics 2013-12-19 Ping-Shou Zhong , Song Xi Chen , Minya Xu

Given a heterogeneous Gaussian sequence model with unknown mean $\theta \in \mathbb R^d$ and known covariance matrix $\Sigma = \operatorname{diag}(\sigma_1^2,\dots, \sigma_d^2)$, we study the signal detection problem against sparse…

Statistics Theory · Mathematics 2023-08-03 Julien Chhor , Rajarshi Mukherjee , Subhabrata Sen

The two-sample test is a fundamental problem in statistics with a wide range of applications. In the realm of high-dimensional data, nonparametric methods have gained prominence due to their flexibility and minimal distributional…

Methodology · Statistics 2024-12-24 Zexi Cai , Wenbo Fei , Doudou Zhou

This paper deals with a new Bayesian approach to the two-sample problem. More specifically, let $x=(x_1,\ldots,x_{n_1})$ and $y=(y_1,\ldots,y_{n_2})$ be two independent samples coming from unknown distributions $F$ and $G$, respectively.…

Statistics Theory · Mathematics 2018-05-21 Luai Al-Labadi

This paper proposes a new class of nonparametric tests for the correct specification of models based on conditional moment restrictions, paying particular attention to generalized propensity score models. The test procedure is based on two…

Econometrics · Economics 2023-04-18 Pedro H. C. Sant'Anna , Xiaojun Song

Two-sample hypothesis testing for random graphs arises naturally in neuroscience, social networks, and machine learning. In this paper, we consider a semiparametric problem of two-sample hypothesis testing for a class of latent position…

Methodology · Statistics 2015-06-19 Minh Tang , Avanti Athreya , Daniel L. Sussman , Vince Lyzinski , Carey E. Priebe

We consider the problem of robustly testing the norm of a high-dimensional sparse signal vector under two different observation models. In the first model, we are given $n$ i.i.d. samples from the distribution…

Information Theory · Computer Science 2022-11-08 Anand Jerry George , Clément L. Canonne

To assess whether there is some signal in a big database, aggregate tests for the global null hypothesis of no effect are routinely applied in practice before more specialized analysis is carried out. Although a plethora of aggregate tests…

Statistics Theory · Mathematics 2024-05-08 Anders Bredahl Kock , David Preinerstorfer