English
Related papers

Related papers: Collaborative Distributed Hypothesis Testing

200 papers

In some applications, an experimental unit is composed of two distinct but related subunits. The response from such a unit is $(X_{1}, X_{2})$ but we observe only $Y_1 = \min\{X_{1},X_{2}\}$ and $Y_2 = \max\{X_{1},X_{2}\}$, i.e., the…

Statistics Theory · Mathematics 2019-05-07 Jiahua Chen , Pengfei Li , Jing Qin , Tao Yu

In this paper, our interest is in the problem of simultaneous hypothesis testing when the test statistics corresponding to the individual hypotheses are possibly correlated. Specifically, we consider the case when the test statistics…

Statistics Theory · Mathematics 2019-01-14 Anupam Kundu , Subir Kumar Bhandari

This work studies the distributed learning process on a network of agents. Agents make partial observation about an unknown hypothesis and iteratively share their beliefs over a set of possible hypotheses with their neighbors to learn the…

Systems and Control · Electrical Eng. & Systems 2024-11-19 P Raghavendra Rao , Pooja Vyavahare

We consider the following communication task in the multi-party setting, which involves a joint random variable $XYZMN$ with the property that $M$ is independent of $YZN$ conditioned on $X$ and $N$ is independent of $XZM$ conditioned on…

Information Theory · Computer Science 2020-03-24 Anurag Anshu , Penghui Yao

In this paper we consider the problem of binary hypothesis testing with finite memory systems. Let $X_1,X_2,\ldots$ be a sequence of independent identically distributed Bernoulli random variables, with expectation $p$ under $\mathcal{H}_0$…

Information Theory · Computer Science 2020-05-18 Tomer Berg , Ofer Shayevitz , Or Ordentlich

We investigate the sample complexity of mutual information and conditional mutual information testing. For conditional mutual information testing, given access to independent samples of a triple of random variables $(A, B, C)$ with unknown…

Data Structures and Algorithms · Computer Science 2025-06-05 Jan Seyfried , Sayantan Sen , Marco Tomamichel

A popular approach for testing if two univariate random variables are statistically independent consists of partitioning the sample space into bins, and evaluating a test statistic on the binned data. The partition size matters, and the…

Methodology · Statistics 2016-04-28 Ruth Heller , Yair Heller , Shachar Kaufman , Barak Brill , Malka Gorfine

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a…

Optimization and Control · Mathematics 2017-04-12 Angelia Nedić , Alex Olshevsky , César A. Uribe

Suppose that at any stage of a statistical experiment a control variable $X$ that affects the distribution of the observed data $Y$ at this stage can be used. The distribution of $Y$ depends on some unknown parameter $\theta$, and we…

Statistics Theory · Mathematics 2009-12-23 Andrey Novikov

This paper studies one-sided hypothesis testing under random sampling without replacement. That is, when $n+1$ binary random variables $X_1,\ldots, X_{n+1}$ are subject to a permutation invariant distribution and $n$ binary random variables…

Statistics Theory · Mathematics 2022-11-07 Zihao Li , Huangjun Zhu , Masahito Hayashi

In the classical two-sample problem, the conventional approach for testing distributions equality is based on the difference between the two marginal empirical distribution functions, whereas a test for independence is based on the contrast…

Statistics Theory · Mathematics 2018-06-14 Laura Dumitrescu , Estate V. Khmaladze

This work studies distributed learning in the spirit of Yao's model of communication complexity: consider a two-party setting, where each of the players gets a list of labelled examples and they communicate in order to jointly perform some…

Machine Learning · Computer Science 2018-04-24 Daniel M. Kane , Roi Livni , Shay Moran , Amir Yehudayoff

We study the role of interactivity in distributed statistical inference under information constraints, e.g., communication constraints and local differential privacy. We focus on the tasks of goodness-of-fit testing and estimation of…

Data Structures and Algorithms · Computer Science 2021-10-26 Jayadev Acharya , Clément L. Canonne , Yuhan Liu , Ziteng Sun , Himanshu Tyagi

Testing conditional independence has many applications, such as in Bayesian network learning and causal discovery. Different test methods have been proposed. However, existing methods generally can not work when only discretized…

Machine Learning · Statistics 2025-03-19 Boyang Sun , Yu Yao , Guang-Yuan Hao , Yumou Qiu , Kun Zhang

The following problem is considered: given a joint distribution $P_{XY}$ and an event $E$, bound $P_{XY}(E)$ in terms of $P_XP_Y(E)$ (where $P_XP_Y$ is the product of the marginals of $P_{XY}$) and a measure of dependence of $X$ and $Y$.…

Information Theory · Computer Science 2019-03-12 Ibrahim Issa , Amedeo Roberto Esposito , Michael Gastpar

This paper considers a problem of distributed hypothesis testing and social learning. Individual nodes in a network receive noisy local (private) observations whose distribution is parameterized by a discrete parameter (hypotheses). The…

Statistics Theory · Mathematics 2016-05-17 Anusha Lalitha , Tara Javidi , Anand Sarwate

Experiments often yield non-identically distributed data for statistical analysis. Tests of hypothesis under such set-ups are generally performed using the likelihood ratio test, which is non-robust with respect to outliers and model…

Statistics Theory · Mathematics 2017-07-25 Abhik Ghosh , Ayanendranath Basu

Two processors output correlated sequences using the help of a coordinator with whom they individually share independent randomness. For the case of unlimited shared randomness, we characterize the rate of communication required from the…

Information Theory · Computer Science 2018-05-09 Gowtham R. Kurri , Vinod M. Prabhakaran , Anand D. Sarwate

The hypothesis of randomness is fundamental in statistical machine learning and in many areas of nonparametric statistics; it says that the observations are assumed to be independent and coming from the same unknown probability…

Probability · Mathematics 2022-02-08 Vladimir Vovk

Secure multi-party computation is a central problem in modern cryptography. An important sub-class of this are problems of the following form: Alice and Bob desire to produce sample(s) of a pair of jointly distributed random variables. Each…

Information Theory · Computer Science 2010-02-10 Vinod Prabhakaran , Manoj Prabhakaran