Related papers: An Information-Theoretic Proof of the Kac--Bernste…
We consider the limiting distribution of the quantity $X^s/(X+Y)^r$, where $X$ and $Y$ are two independent Binomial random variables with a common success probability and a number of trials $n$ and $m$, respectively, and $r,s$ are positive…
It is well known that the independence of the sample mean and the sample variance characterizes the normal distribution. By using Anosov's theorem, we further investigate the analogous characteristic properties in terms of the sample mean…
This paper generalizes Wyner's definition of common information of a pair of random variables to that of $N$ random variables. We prove coding theorems that show the same operational meanings for the common information of two random…
Let $\{X_n\}_{n\geq 1}$ be either a sequence of arbitrary random variables, or a martingale difference sequence, or a centered sequence with a suitable level of negative dependence. We prove Baum-Katz type theorems by only assuming that the…
A basic result is that the sample variance for i.i.d. observations is an unbiased estimator of the variance of the underlying distribution (see for instance Casella and Berger (2002)). But what happens if the observations are neither…
(To appear in The American Statistician.) Distance covariance (Sz\'ekely, Rizzo, and Bakirov, 2007) is a fascinating recent notion, which is popular as a test for dependence of any type between random variables $X$ and $Y$. This approach…
If $\alpha,\beta>0$ are distinct and if $A$ and $B$ are independent non-degenerate positive random variables such that $$S=\tfrac{1}{B}\,\tfrac{\beta A+B}{\alpha A+B}\quad \mbox{and}\quad T=\tfrac{1}{A}\,\tfrac{\beta A+B}{\alpha A+B} $$ are…
The problem of hypothesis testing is examined from both the historical and Bayesian points of view in the case that sampling is from an underlying joint probability distribution and the hypotheses tested for are those of independence and…
We provide a reason for Bayesian updating, in the Bernoulli case, even when it is assumed that observations are independent and identically distributed with a fixed but unknown parameter $\theta_0$. The motivation relies on the use of loss…
The designation ``Bernstein-von Mises theorem'' is apparently due to Lucien Le Cam. Roughly, the assertion of this theorem states that the posterior distribution of a parameter, conditioned on a large sample, is approximately normal,…
We show that many theorems which assert that two kinds of partitions of the same integer $n$ are equinumerous are actually special cases of a much stronger form of equality. We show that in fact there correspond partition statistics $X$ and…
Assume that $X$ and $Y$ are independent random variables, each having a Cauchy distribution with a known median. Taking a random independent sample of size $n$ of each $X$ and $Y$, one can then compute their centralized empirical…
Information and uncertainty are closely related and extensively studied concepts in a number of scientific disciplines such as communication theory, probability theory, and statistics. Increasing the information arguably reduces the…
The Glivenko-Cantelli theorem states that the empirical distribution function converges uniformly almost surely to the theoretical distribution for a random variable $X \in \mathbb{R}$. This is an important result because it establishes the…
In this article we provide a substantial discussion on the statistical concept of conditional independence, which is not routinely mentioned in most elementary statistics and mathematical statistics textbooks. Under the assumption of…
In the current versions of the Dempster-Shafer theory, the only essential restriction on the validity of the rule of combination is that the sources of evidence must be statistically independent. Under this assumption, it is permissible to…
We prove that if two additive functions (from a certain class) take large values with roughly the same probability then they must be identical. The Kac-Kubilius model suggests that the distribution of values of a given additive function can…
The CQC conjecture by Schneeloch et al. (Physical Review A 90.6, 2014) asserts that the sum of classical mutual information between two parties obtained by measuring individual systems in two mutually unbiased bases cannot exceed their…
This paper examines the interdependence generated between two parent nodes with a common instantiated child node, such as two hypotheses sharing common evidence. The relation so generated has been termed "intercausal." It is shown by…
Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…