English
Related papers

Related papers: Hotelling's test for highly correlated data

200 papers

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

Not all experiments publish their results with a description of the correlations between the data points. This makes it difficult to do hypothesis tests or model fits with that data, since just assuming no correlation can lead to an over-…

Data Analysis, Statistics and Probability · Physics 2021-06-30 Lukas Koch

Suppose that at any stage of a statistical experiment a control variable $X$ that affects the distribution of the observed data $Y$ at this stage can be used. The distribution of $Y$ depends on some unknown parameter $\theta$, and we…

Statistics Theory · Mathematics 2009-12-23 Andrey Novikov

We consider the problem of estimating the distribution underlying an observed sample of data. Instead of maximum likelihood, which maximizes the probability of the ob served values, we propose a different estimate, the high-profile…

Artificial Intelligence · Computer Science 2012-07-19 Alon Orlitsky , Narayana Santhanam , Krishnamurthy Viswanathan , Junan Zhang

We present a simple model for the underlying structure of protein-protein pairwise interaction graphs that is based on the way in which proteins attach to each other in experiments such as yeast two-hybrid assays. We show that data on the…

Molecular Networks · Quantitative Biology 2007-05-23 Alun Thomas , Rob Cannings , Nicholas A. M. Monk , Chris Cannings

The framework of distribution testing is currently ubiquitous in the field of property testing. In this model, the input is a probability distribution accessible via independently drawn samples from an oracle. The testing task is to…

Data Structures and Algorithms · Computer Science 2022-09-22 Sourav Chakraborty , Eldar Fischer , Arijit Ghosh , Gopinath Mishra , Sayantan Sen

It is frequently of interest to jointly analyze two paired sequences of multiple tests. This paper studies the problem of detecting whether there are more pairs of tests that are significant in both sequences than would be expected by…

Methodology · Statistics 2017-06-26 Sihai Dave Zhao , T. Tony Cai , Hongzhe Li

In this paper, we consider the hypothesis testing of correlation between two $m$-uniform hypergraphs on $n$ unlabelled nodes. Under the null hypothesis, the hypergraphs are independent, while under the alternative hypothesis, the hyperdges…

Statistics Theory · Mathematics 2022-02-15 Mingao Yuan , Zuofeng Shang

We introduce a testing-by-betting framework that leverages predictions on unlabeled data to enhance the power of sequential hypothesis testing. Given limited samples from the joint distribution of $(X,Y)$, and additional unlabeled samples…

Machine Learning · Computer Science 2026-05-28 Yaniv Tenzer , Elad Tolochinsky , Yaniv Romano

Not many tests exist for testing the equality for two or more multivariate distributions with compositional data, perhaps due to their constrained sample space. At the moment, there is only one test suggested that relies upon random…

Methodology · Statistics 2025-12-12 Volkan Sevinc , Michail Tsagris

Genome-wide association analysis has generated much discussion about how to preserve power to detect signals despite the detrimental effect of multiple testing on power. We develop a weighted multiple testing procedure that facilitates the…

Statistics Theory · Mathematics 2007-06-13 Kathryn Roeder , Bernie Devlin , Larry Wasserman

Combining the complementary capabilities of two of the most powerful modern computational methods, we find superconductivity in both the electron- and hole-doped regimes of the two-dimensional Hubbard model (with next nearest neighbor…

Superconductivity · Physics 2024-05-13 Hao Xu , Chia-Min Chung , Mingpu Qin , Ulrich Schollwöck , Steven R. White , Shiwei Zhang

In big data analysis for detecting rare and weak signals among $n$ features, some grouping-test methods such as Higher Criticism test (HC), Berk-Jones test (B-J), and $\phi$-divergence test share the similar asymptotical optimality when $n…

Statistics Theory · Mathematics 2017-02-24 Hong Zhang , Jiashun Jin , Zheyang Wu

Robust tests of general composite hypothesis under non-identically distributed observations is always a challenge. Ghosh and Basu (2018, Statistica Sinica, 28, 1133--1155) have proposed a new class of test statistics for such problems based…

Statistics Theory · Mathematics 2019-01-08 Abhik Ghosh , Ayanendranath Basu

Identifying informative predictors in a high dimensional regression model is a critical step for association analysis and predictive modeling. Signal detection in the high dimensional setting often fails due to the limited sample size. One…

Methodology · Statistics 2020-04-08 Molei Liu , Yin Xia , Kelly Cho , Tianxi Cai

In this paper, we study the problem of testing the mean vectors of high dimensional data in both one-sample and two-sample cases. The proposed testing procedures employ maximum-type statistics and the parametric bootstrap techniques to…

Statistics Theory · Mathematics 2018-01-23 Jinyuan Chang , Chao Zheng , Wen-Xin Zhou , Wen Zhou

New binary classification tests are often evaluated relative to a pre-established test. For example, rapid Antigen tests for the detection of SARS-CoV-2 are assessed relative to more established PCR tests. In this paper, I argue that the…

Econometrics · Economics 2021-01-21 Gabriel Ziegler

Hierarchical Bayesian methods enable information sharing across multiple related regression problems. While standard practice is to model regression parameters (effects) as (1) exchangeable across datasets and (2) correlated to differing…

Methodology · Statistics 2021-07-15 Brian L. Trippe , Hilary K. Finucane , Tamara Broderick

Motivated by recent experiments realizing correlated phenomena and superconductivity in 2D van der Waals devices, we consider the general problem of whether correlation effects may be enhanced by modifying band structure while keeping a…

Strongly Correlated Electrons · Physics 2019-06-19 Edwin W. Huang , Mohammad-Sadegh Vaezi , Zohar Nussinov , Abolhassan Vaezi

Neural networks excel at discovering statistical patterns in high-dimensional data sets. In practice, higher-order cumulants, which quantify the non-Gaussian correlations between three or more variables, are particularly important for the…

Machine Learning · Statistics 2024-10-16 Eszter Székely , Lorenzo Bardone , Federica Gerace , Sebastian Goldt