English
Related papers

Related papers: Detection of correlations

200 papers

Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high-dimensional regime where the number of parameters exceeds the number of samples ($p> n$). In order to make…

Statistics Theory · Mathematics 2019-09-24 Adel Javanmard , Jason D. Lee

We propose a new approach to sequential testing which is an adaptive (on-line) extension of the (off-line) framework developed in [10]. It relies upon testing of pairs of hypotheses in the case where each hypothesis states that the vector…

Statistics Theory · Mathematics 2017-02-27 Anatoli Juditsky , Arkadi Nemirovski

We consider the problem of detecting an anomaly in the form of a path of correlations hidden in white noise. We provide a minimax lower bound and a test that, under mild assumptions, is able to achieve the lower bound up to a multiplicative…

Statistics Theory · Mathematics 2016-12-23 Ery Arias-Castro , Gábor Lugosi , Nicolas Verzelen

We propose new statistical tests, in high-dimensional settings, for testing the independence of two random vectors and their conditional independence given a third random vector. The key idea is simple, i.e., we first transform each…

Methodology · Statistics 2026-01-28 Jinyuan Chang , Yue Du , Jing He , Qiwei Yao

We address the problem of one dimensional segment detection and estimation, in a regression setup. At each point of a fixed or random design, one observes whether that point belongs to the unknown segment or not, up to some additional…

Statistics Theory · Mathematics 2014-04-25 Victor-Emmanuel Brunel

We consider the problem of testing for the presence of linear relationships between large sets of random variables based on a post-selection inference approach to canonical correlation analysis. The challenge is to adjust for the selection…

Methodology · Statistics 2020-10-20 Ian W. McKeague , Xin Zhang

We describe two families of statistical tests to detect partial correlation in vectorial timeseries. The tests measure whether an observed timeseries Y can be predicted from a second series X, even after accounting for a third series Z…

Methodology · Statistics 2024-04-25 Kenneth D. Harris , Alex E. Yuan

In this paper, we consider the hypothesis testing of correlation between two $m$-uniform hypergraphs on $n$ unlabelled nodes. Under the null hypothesis, the hypergraphs are independent, while under the alternative hypothesis, the hyperdges…

Statistics Theory · Mathematics 2022-02-15 Mingao Yuan , Zuofeng Shang

There is growing concern about tacit collusion using algorithmic pricing, and regulators need tools to help detect the possibility of such collusion. This paper studies how to design a hypothesis testing framework in order to decide whether…

Computer Science and Game Theory · Computer Science 2020-03-31 Pedro Hespanhol , Anil Aswani

We consider sequential hypothesis testing based on observations which are received in groups of random size. The observations are assumed to be independent both within and between the groups. We assume that the group sizes are independent…

Methodology · Statistics 2021-10-11 Andrey Novikov , Xóchitl Itxel Popoca-Jiménez

The adjacency matrix is the most fundamental and intuitive object in graph analysis that is useful not only mathematically but also for visualizing the structures of graphs. Because the appearance of an adjacency matrix is critically…

Social and Information Networks · Computer Science 2023-04-07 Tatsuro Kawamoto , Teruyoshi Kobayashi

We show that the last few components in principal component analysis of the correlation matrix of a group of stocks may contain useful financial information by identifying highly correlated pairs or larger groups of stocks. The results of…

Portfolio Management · Quantitative Finance 2015-12-14 Libin Yang , William Rea , and Alethea Rea

In the report the approach to estimation of quality of planned experiments is considered. This approach is based on the analysis of uncertainty, which will take place under the future hypotheses testing about the existence of a new…

Data Analysis, Statistics and Probability · Physics 2009-11-10 S. I. Bityukov , N. V. Krasnikov

In this paper, we address the problem of testing independence between two high-dimensional random vectors. Our approach involves a series of max-sum tests based on three well-known classes of rank-based correlations. These correlation…

Methodology · Statistics 2024-04-04 Hongfei Wang , Binghui Liu , Long Feng

The simplicity of a question such as wondering if correlations characterize or not a certain system collides with the experimental difficulty of accessing such information. Here we present a low demanding experimental approach which refers…

The classical binary hypothesis testing problem is revisited. We notice that when one of the hypotheses is composite, there is an inherent difficulty in defining an optimality criterion that is both informative and well-justified. For…

Statistics Theory · Mathematics 2021-03-29 Michael Bell , Yuval Kochman

Hypothesis testing plays a central role in statistical inference, and is used in many settings where privacy concerns are paramount. This work answers a basic question about privately testing simple hypotheses: given two distributions $P$…

Data Structures and Algorithms · Computer Science 2019-04-04 Clément L. Canonne , Gautam Kamath , Audra McMillan , Adam Smith , Jonathan Ullman

A number of biomedical problems require performing many hypothesis tests, with an attendant need to apply stringent thresholds. Often the data take the form of a series of predictor vectors, each of which must be compared with a single…

Methodology · Statistics 2014-05-13 Yi-Hui Zhou , Fred Wright

A sequential test is proposed for detection and isolation of hubs in a correlation graph. Hubs in a correlation graph of a random vector are variables (nodes) that have a strong correlation edge. It is assumed that the random vectors are…

Statistics Theory · Mathematics 2017-02-07 Taposh Banerjee , Alfred O. Hero

In this article, we consider the problem of testing the independence between two random variables. Our primary objective is to develop tests that are highly effective at detecting associations arising from explicit or implicit functional…

Methodology · Statistics 2025-02-21 Seetharaman P , Sagnik Das , Angshuman Roy