English
Related papers

Related papers: Sparse-limit approximation for t-statistics

200 papers

Statistical dependence between hypotheses poses a significant challenge to the stability of large scale multiple hypotheses testing. Ignoring it often results in an unacceptably large spread in the false positive proportion even though the…

Methodology · Statistics 2018-10-15 Sairam Rayaprolu , Zhiyi Chi

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

We study the rate of decay of the probability of error for distinguishing between a sparse signal with noise, modeled as a sparse mixture, from pure noise. This problem has many applications in signal processing, evolutionary biology,…

Information Theory · Computer Science 2016-12-28 Jonathan G. Ligo , George V. Moustakides , Venugopal V. Veeravalli

In genomics, differential abundance and expression analyses are complicated by the compositional nature of sequence count data, which reflect only relative-not absolute-abundances or expression levels. Many existing methods attempt to…

Methodology · Statistics 2025-12-16 Won Gu , Francesca Chiaromonte , Justin D. Silverman

Detection of sparse signals arises in a wide range of modern scientific studies. The focus so far has been mainly on Gaussian mixture models. In this paper, we consider the detection problem under a general sparse mixture model and obtain…

Information Theory · Computer Science 2012-11-13 T. Tony Cai , Yihong Wu

In this paper, we derive a new version of Hanson-Wright inequality for a sparse bilinear form of sub-Gaussian variables. Our results are generalization of previous deviation inequalities that consider either sparse quadratic forms or dense…

Statistics Theory · Mathematics 2022-09-21 Seongoh Park , Xinlei Wang , Johan Lim

Sparse networks can be found in a wide range of applications, such as biological and communication networks. Inference of such networks from data has been receiving considerable attention lately, mainly driven by the need to understand and…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Junyang Jin , Ye Yuan , Jorge Goncalves

We consider the problem of detecting a general sparse mixture and obtain an explicit characterization of the phase transition under some conditions, generalizing the univariate results of Cai and Wu. Additionally, we provide a sufficient…

Statistics Theory · Mathematics 2021-05-27 Subhodh Kotekal

In this paper, we study the detection boundary for minimax hypothesis testing in the context of high-dimensional, sparse binary regression models. Motivated by genetic sequencing association studies for rare variant effects, we investigate…

Statistics Theory · Mathematics 2015-03-06 Rajarshi Mukherjee , Natesh S. Pillai , Xihong Lin

In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed.…

Methodology · Statistics 2021-03-25 Rui Duan , Yang Ning , Yong Chen

A nonparametric Bayes approach is proposed for the problem of estimating a sparse sequence based on Gaussian random variables. We adopt the popular two-group prior with one component being a point mass at zero, and the other component being…

Methodology · Statistics 2017-05-31 Yunbo Ouyang , Feng Liang

In a bivariate setting, we consider the problem of detecting a sparse contamination or mixture component, where the effect manifests itself as a positive dependence between the variables, which are otherwise independent in the main…

Statistics Theory · Mathematics 2020-01-13 Ery Arias-Castro , Rong Huang , Nicolas Verzelen

Genetical genomics experiments have now been routinely conducted to measure both the genetic markers and gene expression data on the same subjects. The gene expression levels are often treated as quantitative traits and are subject to…

Applications · Statistics 2012-03-01 Jianxin Yin , Hongzhe Li

This paper resolves two open problems from a recent paper, arXiv:2403.16981, concerning the sample complexity of distributed simple binary hypothesis testing under information constraints. The first open problem asks whether interaction…

Information Theory · Computer Science 2025-06-18 Hadi Kazemi , Ankit Pensia , Varun Jog

Sparse models are desirable for many applications across diverse domains as they can perform automatic variable selection, aid interpretability, and provide regularization. When fitting sparse models in a Bayesian framework, however,…

Statistics Theory · Mathematics 2020-10-15 Jeffrey P. Spence

In this paper we analyse the behaviour of adaptive filters or detectors when they are trained with $t$-distributed samples rather than Gaussian distributed samples. More precisely we investigate the impact on the distribution of some…

Statistics Theory · Mathematics 2021-03-04 Olivier Besson

In a novel approach to the multiple testing problem, Efron (2004; 2007) formulated estimators of the distribution of test statistics or nominal p-values under a null distribution suitable for modeling the data of thousands of unaffected…

Methodology · Statistics 2012-10-30 David R. Bickel

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

Machine Learning · Computer Science 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

We prove concentration inequalities of the form $P(Y \ge t) \le \exp(-B(t))$ for a random variable $Y$ with mean zero and variance $\sigma^2$ using a coupling technique from Stein's method that is so-called approximate zero bias couplings.…

Probability · Mathematics 2025-12-24 Nathakhun Wiroonsri

Recent advances in engineering technologies have enabled the collection of a large number of longitudinal features. This wealth of information presents unique opportunities for researchers to investigate the complex nature of diseases and…

Methodology · Statistics 2023-11-27 Zihang Lu , Noirrit Kiran Chandra